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Executive  Suwnary 


1.  The  objective  of  this  Guidebook  Is  to  provide  techniques  for  planning 
and  evaluating  Environmental  Stress  Screening  f ESS )  programs.  The 
guidance  contained  herein  departs  from  other  approaches  to  ESS  in  that 
quantitative  methods  are  used  to  plan  and  control  both  the  cost  and  effec¬ 
tiveness  of  ESS  programs.  Guidebook  procedures  and  methodology  were  de¬ 
veloped  under  RADC  contractual  aid  In-house  studies.  Contractual  efforts 
were  performed  by  the  Hughes  Aircraft  Company  of  Fullerton,  California, 
under  the  direction  of  Mr.  A.  E.  Saarl.  The  Guidebook  has  been  prepared  in 
MIL-HDBK  format  to  facilitate  Its  eventual  release,  when  other  OOD  and 
Industry  inputs  become  available,  as  a  fully  coordinated  military  hand¬ 
book. 

2.  Environmental  Stress  Screening  f ESS )  programs,  which  are  applied  dur¬ 
ing  the  production  phase,  can  yield  significant  improvements  in  field 
reliability  and  reductions  In  field  maintenance  costs.  The  benefits  for 
the  manufacturer  Include:  a  high  degree  of  visibility  as  to  the  sources  of 
reliability  problems  in  the  product  or  process,  better  control  of  rework 
costs,  and  the  opportunity  to  determine  corrective  actions  which  eliminate 
the  sources  of  reliability  problems  from  the  product  or  process. 

3.  ESS  Is  an  emerging  technology  and  there  are  various  approaches  asso¬ 
ciated  with  the  application  of  stress  screens.  Regardless  of  the  approach 
used,  the  fundamental  objective  of  ESS  remains  the  same  l.e.  to  remove 
latent  defects  from  the  product  prior  to  field  delivery.  The  quantitative 
methods  contained  in  this  guidebook  extend  this  objective  by  focusing  on 
the  defects  which  remain  In  the  product  at  delivery  and  their  Impact  on 
field  reliability.  The  goal  of  ESS  programs  thus  becomes  to  reduce  the 
latent  defect  population,  at  delivery,  to  a  level  which  is  consistent  with 
the  reliability  requirements  for  the  product.  Reduction  of  the  latent 
defect  population  In  a  production  lot  of  electronic  equipment,  Is  accom¬ 
plished  by: 


•  Use  of  ESS  results  to  Isolate  defect- failure  causes  followed  by 
determining  appropriate  corrective  actions.  Effective  corrective  actions 
eliminate  the  source  (cause)  of  the  defect  from  the  process  or  product, 
thereby  improving  manufacturing  process  capability. 

•  Use  of  ESS  to  precipitate  flaws  in  the  assembled  hardware  to  a 
detectable  level  coupled  with  the  use  of  thorough  tests  to  facilitate  their 
detection  and  removal. 

4.  The  guidebook  is  organized  according  to  the  general  sequence  of  events 
to  be  undertaken  by  the  contractor  in  planning,  monitoring  and  controlling 
a  screening  program.  Five  detailed  procedures,  contained  in  Section  5  of 
the  guideline,  are  used  to  assist  the  user  in  accomplishing  ESS  planning 
and  evaluation  activities.  The  detailed  procedures  are  entitled: 

•  Procedure  A  -  Planning  Estimates  of  Incoming  Defect  Density 

•  Procedure  B  -  Screen  Selection  and  Placement 

•  Procedure  C  -  Failure-Free  Acceptance  Tests 

•  Procedure  D  -  Cost  Effectiveness  Analysis 

•  Procedure  E  -  Monitoring,  Evaluation  and  Control 

Section  2  of  the  guidebook  lists  references  used  in  its  preparation,  and 
Section  3  defines  terms  and  acronyms  used.  Section  4  and  the  appendices 
contain  general  guidelines  and  the  background  information  necessary  for 
understanding  the  rationale  for  and  use  of  the  detailed  procedures. 

The  product  development  phase  is  used  to  experiment  with  various 
stress  screens  and  to  define  and  plan  a  cost  effective  screening  regimen 
for  production.  (Section  4.8  and  4.9).  After  the  screening  program  is 
implemented  during  production,  stress  screening  results  are  used  to 
evaluate  the  screening  process  to  establish  whether  program  objectives  are 
being  achieved.  (Section  4.11).  Quantitative  objectives  for  the  screen¬ 
ing  program  must  be  established  early.  Appendix  B  provides  the  rationale 
used  for  establishing  quantitative  goals  which  are  related  to  reliability 
requirements  for  the  product.  Appendix  A  contains  the  mathematical  rela 


tlons  and  model  descriptions  used  in  the  guidebook.  A  review  of  Appendix  A 
will  help  the  interested  reader  in  gaining  a  quick  understanding  of  the 
rationale  and  methodology  of  the  guidebook.  Appendix  C  provides  the 
derivation  of  the  Failure  Free  Acceptance  Test. 


5.  It  should  be  noted  that  is  is  not  possible  to  remove  all  defects  from 
the  hardware  through  stress  screening.  The  vast  majority  of  parts  in  the 
hardware  have  failure  rates  sufficiently  low  so  that  they  never  fail 
throughout  the  life  of  the  product.  Gross  latent  defects  tend  to  fail 
early  and  dominate  the  reliability  of  fielded  products  during  early  life. 
The  objective  is  to  remove  as  many  of  the  gross  defects  from  the  hardware 
as  is  technically  and  economically  feasible  so  as  to  achieve  the  designed- 
in  reliability.  The  guidebook  implements  these  objectives  through  use  of 
controls  on  the  defects  remaining  in  the  hardware  at  delivery,  the  costs  to 
precipitate  and  remove  them,  and  the  assurance  needed  that  reliability 
objectives  have  been  achieved. 
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1.1  Purpose.  This  guidebook  provides  uniform  procedures,  methods  and 
techniques  for  Dlanning,  monitoring  and  controlling  the  cost  effectiveness 
of  ESS  programs  for  electronic  equipment.  It  is  intended  to  support  the 
requirements  of  MIL-STD-785  ,  "Reliability  Program  for  Systems  and  Equip¬ 
ment  Development  and  Production",  Task  301,  "Environmental  Stress 
Screening" . 

1.2  Application.  The  guidebook  is  Intended  for  use  by  procuring 
activities  and  contractors  during  development  and  production.  It  is  not 
intended  that  the  guidebook  procedures  and  techniques  be  used  in  a  cookbook 
fashion.  Knowledge  of  the  equipment  and  the  manufacturing  process  is 
essential  for  a  properly  planned  and  tailored  ESS  program.  The  data  base 
needed  for  a  systematic  approach  to  ESS  application  is  not  fully  developed. 
Use  of  the  guidebook,  by  Government  procuring  agencies  and  military  equip¬ 
ment  manufacturers  will  foster  the  development  of  an  Improved  and  broader 
data  base. 

1 .3  General .  A  properly  applied  ESS  program  can  significantly  impact  the 
quality  and  reliability  of  electronic  products  delivered  to  the 
Government.  ESS  Is  interrelated  with  the  requirements  set  forth  In  MIL-Q- 
9858,  "Quality  Program  Requirements"  and  MIL-STD-785,  "Reliability  Program 
for  Systems  and  Equipment  Development  and  Production".  Quality  Control  Is 
a  manufacturing  function  and  Reliability  Engineering  Is  a  design  function. 
Although  the  Quality  and  Reliability  disciplines  are  related,  in  practice, 
they  are  conducted  as  separate  programs  without  common  objectives.  The 
guidebook  uses  the  ESS  program  as  a  means  for  integrating  Quality  Control 
and  Reliability  Engineering  tasks  so  as  to  assure  achievement  of 
reliability  objectives  during  manufacture. 

1,3.1  What  is  ESS?  ESS  is  a  process  or  series  of  processes  in  which 
environmental  stimuli  are  applied  to  electronic  items  in  order  to 
precipitate  latent  defects  to  early  failure.  An  equally  important  and 
inseparable  aspect  of  the  screening  process  is  the  testing  which  is  done, 
either  during  or  following  the  screen,  to  detect  and  Isolate  the  defects 


which  havo  been  precipitated  to  failure  by  the  screen.  The  screening  and 
testing  process  is  basically  a  search  for  defects.  Manufacturing  tech¬ 
niques  for  modern  electronic  hardware  consist  of  hundreds  of  individual 
operations  and  processes  through  which  defects  can  be  Introduced  into  the 
product.  Many  of  the  defects  can  be  detected  without  the  need  for  stress 
screens  by  use  of  visual  inspections,  functional  tests  and  other 
conventional  quality  assurance  procedures.  However,  a  small  percentage  of 
latent  defects  remain  undetected  by  obvious  means  and,  if  not  removed  in 
the  factory,  will  eventually  manifest  as  early  life  failures  during 
product  use.  The  inability  to  find  defects  by  obvious  means  is  a 
consequence  of  the  increased  complexity  of  modern  electronic  products  and 
the  processes  which  are  used  in  their  manufacture.  ESS  is  the  vehicle  by 
which  latent  defects  are  accelerated  to  early  failure  in  the  factory.  ESS 
can  thus  be  viewed  as  an  extension  of  the  quality  control  inspection  and 
testing  process. 


1.3.2  Development  and  Production  Phase  Reliability  Assurance.  ESS  is  not 


a  substitute  for  a  sound  reliability  program  conducted  during  the  desi 


and  development  phases.  The  inherent  reliability  of  the  product  is  driven 
primarily  by  the  design.  However,  without  a  viable  reliability  assurance 
program  during  production,  the  reliability  which  is  designed  into  the 
product  can  be  seriously  degraded.  An  equipment  will  eventually  pass  a 
M1L-STD-781  reliability  demonstration  test,  either  during  development  or 
on  a  sample  basis  during  production.  A  single  equipment  passing  the  MIL- 
STD-781  test  does  not  Imply  that  all  other  equipments  in  the  production  lot 
have  the  same  reliability.  A  relatively  few  latent  defects  contained  in 
various  equipments  in  the  lot  can  significantly  reduce  the  field 
reliability,  especially  for  equipments  with  high  reliability  requirements. 
A  production  reliability  assurance  program  which  complements  the 
design/development  reliability  program,  is  therefore  essential  to 
achieving  reliability  objectives.  A  properly  planned,  monitored  and 
controlled  stress  screening  program,  structured  as  part  of  a  production 


reliability  assurance  program,  is  the  vehicle  through  which  product 
reliability  in  manufacture  can  be  maintained.  The  procedures  presented  In 
this  guideline  are  oriented  toward  achieving  reliability  objectives 
through  use  of  quantitative  methods  for  stress  screening  and  production 
reliability  assurance. 

1.3.3  ESS  Application  &  The  Quantitative  Approach.  Historically  there 
have  been  two  basic  approaches  to  the  application  of  stress  screens.  In 
one  approach,  the  Government  explicitly  specifies  the  screens  and 
screening  parameters  to  be  used  at  various  assembly  lev.els.  Failure-free 
periods  are  sometimes  attached  to  the  screens,  as  acceptance  requirements, 
in  order  to  provide  assurance  that  the  product  is  reasonably  free  of 
defects.  Another  approach  is  to  have  the  contractor  propose  a  screening 
program  which  is  tailored  to  the  product  and  is  subject  to  the  approval  of 
the  procuring  activity.  Although  the  latter  approach  is  preferred, 
neither  approach  is  adequate  since  explicit  objectives  and  the  relations 
between  the  screening  program  and  quantitative  reliability  requirements 
are  never  defined.  Costs  are  also  uncontrolled  because  some  of  the  screens 
might  be  more  efficiently  performed  at  lower  assembly  levels  where  rework 
costs  are  lower.  In  addition,  screening  levels  may  far  exceed  the  design 
limits  of  the  product  and  result  in  damage  to  the  equipment. 

There  are  several  unknowns  associated  with  the  application  of  stress 
screens.  How  effective  are  the  screens?  What  is  considered  acceptable  or 
unacceptable  fallout  from  a  screen?  How  does  the  quantity  of  defects 
remaining  in  the  equipment  after  delivery  to  the  customer  impact  field 
reliability?  The  aforementioned  ESS  approaches  do  not  fully  address  these 
questions.  For  example,  if  the  screen  fallout  is  "low",  it  Is  not  known 
whether  the  equipment  is  "good"  (i.e.,  defect-free)  or  whether  the  screen 
is  not  effective.  On  the  other  hand,  if  the  fallout  is  "high".  It  is  not 
known  whether  the  incoming  defect  levels  are  inordinately  high  or  whether 
the  screen  might  be  causing  non-defectives  to  fail. 
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Screens  and  tests  are  not  perfect.  At  each  stage  of  manufacture  where 
screens  and  tests  might  be  applied,  from  device  level  to  the  final  system 
level,  escapes  to  the  next  assembly  stage  occur  and  new  opportunities  for 
introducing  defects  are  created.  The  number  of  defects  which  remain  in  the 
product  at  delivery  and  their  impact  on  field  reliability,  however.  Is  the 
primary  concern. 

1 .3.3.1  The  Quantitative  Approach.  The  use  of  a  quantitative  approach  to 
stress  screening  requires  that  the  defect  levels  introduced  into  the 
product,  the  effectiveness  of  the  screens,  and  reasonably  acceptable 
values  for  the  number  of  defects  which  remain  and  escape  into  the  field  be 
addressed.  Figure  1.1  illustrates  the  quantitative  aspects  of  stress 
screening. 


figure  1.1  The  Quantitative  Problem 


When  a  quantitative  approach  to  stress  screening  is  used  the  variables  of 
interest  are  the  average  number  of  defects  per  product  which  enter  the 
screening  process  ( D j^) *  the  screen/test  effectiveness  or  test  strength 
(TS)  and  the  average  number  of  defects  per  product  which  escape  the 
screen/test  (0Qut)*  Figure  1.2  shows  the  relationships  between  these 
stress  screening  variables. 
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figure  1.2  Stress  Screening  Variables 


The  number  of  defects  remaining  in  the  production  lot  at  delivery  is  a 
function  of  three  key  factors: 

•  The  quantity  of  design,  part  and  manufacturing  (workmanship  and 
process)  defects  which  initially  reside  in  the  hardware  prior  to 
assembly  level  screening. 

•  The  capability  of  the  screens  to  precipitate  flaws  in  assemblies 
to  a  detectable  level. 

•  The  thoroughness  of  the  testing  which  is  done,  either  during  or 
after  the  screen,  to  assure  detection  and  removal  of  the  defects 
precipitated  to  failure  by  the  screens. 
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None  of  the  three  factors  which  Impact  the  reliability  of  delivered 
products  Is  known  with  certainty.  Without  a  basic  knowledge  of  their 
quantitative  value,  however,  effective  screening  programs  cannot  be 
properly  planned  and  controlled.  The  procedures  In  the  guideline  are 
directed  to  obtaining  both  preliminary  planning  and  measured  estimates  of 
the  three  factors  in  order  to  plan,  monitor  and  control  the  screening 
process.  Experience  data  gathered  from  previous  screening  programs, 
screening  experiments  conducted  during  the  development  phase  and  use  of 
the  guidebook  procedures  provides  the  methodology  and  information  needed 
to  plan  and  conduct  effective  screening  programs. 

Once  a  screening  program  is  Implemented  during  production,  the  results 
must  be  monitored  and  appropriate  changes  made  In  the  screening  regimen  to 
assure  that  goals  on  remaining  defects  are  achieved.  The  basic  mechanism 
for  assuring  control  Is  to  compare  the  screening  results  with  established 
goals  so  as  to  determine  the  need  for  corrective  actions.  Such  actions 
could  Involve  increasing  screening  or  test  detection  capability  so  that 
more  defects  can  be  precipitated  and  detected  or  reducing  incoming  defect 
quantities  through  Improved  process  controls.  Changes  which  reduce  or 
eliminate  screening  at  some  levels  of  assembly  can  also  be  taken  to  reduce 
costs,  when  It  Is  found  that  the  screens  are  ineffective  or  unnecessary. 

1.3.4  Benefits  of  a  Quantitative  Approach.  A  quantitative  approach  to 
stress  screening  enables  the  establishment  of  explicit  quantitative 
objectives  and  provides  a  basis  for  planning,  monitoring  and  controlling 
the  screening  process  to  meet  those  objectives.  A  quantitative  approach 
also  facilitates  Government  and  contractor  communication  on  the  status  of 
the  screening  process  and  on  the  progress  being  made  toward  achieving 
objectives.  Coupled  with  a  good  Failure  Reporting  Analysis  and  Corrective 
Action  System  (FRACAS),  the  quantitative  approach  also  provides  a  more 
focused  emphasis  on  the  sources  of  latent  reliability  problems  In  the 
product  or  process  as  well  as  better  control  of  costs. 
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1.3.5  Process  Capability  and  Defect  Density.  The  use  of  a  quantitative 
approach  to  stress  screening  requires  addressing  the  capability  of  the 
manufacturing  process  to  produce  products  which  are  reasonably  free  of 
defects.  Defects  are  Introduced  into  a  lot  of  manufactured  products 
through  repeated  assembly,  handling  and  testing  operations.  The  average 
number  of  defects  per  product  (defect  density)  varies  as  a  function  of  the 
degree  of  control  which  Is  exercised  over  the  manufacturing  process.  When 
the  variation  is  due  only  to  random  noncorrectable  causes,  the  process  Is 
said  to  be  in  control.  The  range  over  which  such  variability  occurs  Is 
often  referred  to  as  the  process  capability.  In  quantitative  terms,  the 
process  capability  can  be  defined  in  terms  of  a  process  mean  (average 
defect  density)  and  a  standard  deviation.  Process  capability  determines 
defect  density  and  not  vice  versa.  Quality  control  studies  are  often 
performed  to  establish  process  capability.  However,  rather  than  ask  the 
question:  What  Is  the  process  capability?,  one  should  ask:  What  must  the 
process  capability  be  in  order  to  meet  quantitative  reliability 
objectives?  The  use  of  a  quantitative  approach  to  stress  screening  focuses 
attention  on  the  latter  question.  Analyses  of  screening  failures  should  be 
directed  to  determining  root  causes  of  defects  and  corrective  actions  so  as 
to  Improve  the  process  capability.  Process  capability  is  improved  only 
through  reducing  the  number  of  failure  causes  which  are  falsely  deemed  to 
be  noncorrectable. 

1.3.6  Organization  of  the  Guidebook.  The  guidebook  Is  organized 
according  to  the  general  sequence  of  events  to  be  undertaken  by  the 
contractor  in  planning,  monitoring  and  controlling  a  screening  program. 
Five  detailed  procedures,  contained  in  Section  5  of  the  guideline,  are  used 
to  assist  the  user  In  accomplishing  ESS  planning  and  evaluation 
activities.  The  detailed  procedures  are  entitled: 

I  Procedure  A  -  Planning  Estimates  of  Incoming  Defect  Density 

•  Procedure  B  -  Screen  Selection  and  Placement 


•  Procedure  C  -  Failure-Free  Acceptance  Tests 

•  Procedure  D  -  Cost  Effectiveness  Analysis 

•  Procedure  E  -  Monitoring,  Evaluation  and  Control 

Section  2  of  the  guidebook  lists  references  used  in  its  preparation,  and 
Section  3  defines  terms  and  acronyms  used.  Section  4  and  the  appendices 
contain  general  guidelines  and  the  background  information  necessary  for 
understanding  the  rationale  for  and  use  of  the  detailed  procedures. 

The  product  development  phase  is  used  to  experiment  with  various 
stress  screens  and  to  define  and  plan  a  cost  effective  screening  regimen 
for  production.  (Section  4.8  and  4.9).  After  the  screening  program  is 
implemented  during  production,  stress  screening  results  are  used  to 
evaluate  the  screening  process  to  establish  whether  program  objectives  are 
being  achieved.  (Section  4.11).  Quantitative  objectives  for  the 
screening  program  must  be  established  early.  Appendix  B  provides  the 
rationale  used  for  establishing  quantitative  goals  which  are  related  to 
reliability  requirements  for  the  product.  Appendix  A  contains  the 
mathematical  relations  and  model  descriptions  used  in  the  guidebook.  A 
review  of  Appendix  A  will  help  the  interested  reader  in  gaining  a  quick 
understanding  of  the  rationale  and  methodology  of  the  guidebook.  Appendix 
C  provides  the  derivation  of  the  Failure  Free  Acceptance  Test. 

Figure  1.3  shows  the  sequence  of  application  of  the  various  ESS  tasks 
contained  in  the  guidebook.  References  to  the  applicable  sections  of  the 
guidebook  are  provided  for  each  task  included  in  the  figure. 
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2.  Referenced  Documents  The  documents  cited  In  this  Section  are  for 
guidance  and  Information. 
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2.1.2  MIL-STD-785 ,  "Reliability  Program  For  Systems  and  Equipment 

Development  &  Production" 
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2.2  Other  rVul ications. 

2.2.1  Saari,  A.E.,  Schafer,  R.E.,  and  VanDen  Berg,  S.J.,  "Stress 

Screening  cf  Electronic  Hardware",  Hughes  Aircraft  Company,  RADC- 
TR-82-87  ,  May  82  (All 8261  ) 

2.2.2  Saari,  A.E.,  Van  Den  Berg,  S.J.,  and  Angus,  J.E.,  "Environmental 
Stress  Screening",  Hughes  Aircraft  Company,  RADC-TR-86-149 

2.2.3  NAVMAT  P-9492,  "Navy  Manufacturing  Screening  Program",  May  79 
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Screening  Guidelines",  1981 

2.2.6  Anderson,  J.R.,  "Environmental  Burn-In  Effectiveness",  McDonnell 
Aircraft  Company,  St.  Louis,  MO,  Report  No.  AFWAL  TR-80-3086,  Aug 
80 

2.2.7  Fertlg,  K.W.,  Murthy,  V.K,  "Models  for  Reliability  Growth  During 
Burn-In",  Proceedings  of  the  1978  Annual  R&M  Symposium,  pp.  504- 
509. 


2.2.8  Bateson,  O.T.,  "Board  Test  Strategies  -  Production  Testing  In  the 
Factory  of  the  Future",  Test  and  Measurement  World,  pp.  118-129, 
Dec  84. 

2.2.9  Kube,  F.,  Hi rschberger ,  G.,  "An  Investigation  to  Determine 
Effective  Equipment  Acceptance  Test  Methods",  Grunman  Aerospace 
Corporation,  Report  No.,  ADR  14-04-73,  Apr  73 

2.2.10  Brownlee,  K.A.  (1960),  Statistical  Theory  and  Methodology  In 
Science  and  Engineering,  New  York,  John  Wiley  and  Sons 


3.  Definitions  and  Acronyms 


3.1  Definitions.  Definitions  applicable  to  this  guidebook  are: 

Detectable  Failures  A  failure  that  can  be  detected  with  100%  test 

detection  efficiency. 

Failure-Free  Period  A  contiguous  period  of  time  during  which  an 

item  is  to  operate  without  the  occurrence  of  a 
failure  while  under  environmental  stress. 

Failure-Free  Test  A  test  to  determine  if  an  equipment  can 

operate  without  failure  for  a  predetermined 
time  period  under  specific  stress  conditions. 

Fallout  Failures  observed  during,  or  immediately 

after,  and  attributed  to  stress  screens. 
Symbol  used  F. 

Part  Fraction  Defective  The  number  of  defects  contained  in  a  part 

population  divided  by  the  total  number  of 
parts  in  the  population  expressed  in  PPM. 

Latent  Defect  An  inherent  weakness  that  has  a  high 

probability  of  resulting  in  an  early  life 
failure  under  field  stress  conditions. 


Patent  Defect  A  failure,  usually  one  waiting  to  be  detected 

without  the  need  for  stress  screens. 


Precipitation  (of  Defects) 
Screen  Effectiveness 


Screen  Parameters 


Screening  Regimen 


The  process  of  transforming  a  latent  defect 
into  a  patent  defect. 

Generally,  a  measure  of  the  ability  of  a 
screen  to  precipitate  defects.  Sometimes  used 
specifically  to  mean  screening  strength. 

Parameters  in  screening  strength  equations 
which  relate  to  screening  strength,  (  e.g., 
vibration  g-levels,  temperature  rate  of 
change  and  time  duration.) 

A  combination  of  stress  screens  applied  to  an 
equipment,  identified  in  the  order  of 
application  (i.e.,  assembly,  unit  and  system 
screens) . 


Screening  Strength  The  probability  that  a  screen  will  precipitate 

a  defect,  given  that  a  defect  susceptible  to 
the  screen  is  present.  Symbol  (SS) 


Selection  and  Placement 


Stress  Screening 


The  process  of  systematically  selecting  the 
most  effective  stress  screens  and  placing  them 
at  the  appropriate  levels  of  assembly. 

The  process  of  applying  mechanical, 
electrical  and/or  thermal  stresses  to  an 
equipment  item  for  the  purpose  of 
precipitating  latent  part  and  workmanship 
defects  to  early  failure. 
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Definitions  Continued 


Test  Detection  Efficiency 

Test  Strength 

Thermal  Survey 

Vibration  Survey 

Yield 

Defect  Density 

Production  Lot 

Assembly /Module 


Failure  Rate 

Escapes 

Item 


A  characteristic  of  a  test  measured  by  the 
ratio  of  the  number  of  failure  modes 
detectable  to  the  total  number  of  failure 
modes.  The  probability  of  detection.  Symbol 
(OE). 

The  product  of  screening  strength  and  test 
detection  efficiency.  The  probability  that  a 
defect  will  be  precipitated  by  a  screen  and 
detected  In  a  test.  Symbol  (TS). 

The  measurement  of  thermal  response 
characteristics  at  points  of  interest  within 
an  equipment  when  temperature  extremes  are 
applied  to  the  equipment. 

The  measurement  of  vibration  response 
characteristics  at  points  of  interest  within 
an  equipment  when  vibration  excitation  is 
applied  to  the  equipment. 

The  probability  that  an  equipment  is  free  of 
defects  when  offered  for  acceptance. 

Average  number  of  defects  per  item.  Symbols 
Used:  D.N  and  DR  for  Incoming  and  remaining 
defect  density,  respectively. 

A  group  of  items  manufactured  under 
essentially  the  same  conditions  and 
processes. 

A  number  of  parts  joined  together  to  perform  a 
specific  function  and  capable  of  disassembly. 
For  example  a  printed  circuit  board. 

An  assembly  of  parts  designed  to  function  In 
conjunction  with  similar  or  different  modules 
when  assembled  into  a  unit.  (i.e.  Printed 
Circuit  Assembly,  power  supply  module,  core 
memory  module.) 

The  total  number  of  failures  within  an  item 
population,  divided  by  the  total  number  of 
life  units  expended  by  that  population  during 
a  particular  measurement  interval  under 
stated  conditions.  Symbol  used  X.  A 
reliability  measure  related  to  MTBF. 

A  proportion  of  incoming  defect  density  which 
is  not  detected  by  a  screen  and  test  and  which 
is  passed  on  to  the  next  level.  Symbol  (Dout) 

A  non-specific  term  to  denote  any  product 
including  systems,  materials,  parts, 
subassemblies,  sets,  accessories,  etc. 
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Part 


Any  identifiable  item  within  the  product  which 
can  be  removed  or  repaired  (e.g.,  discrete 
semiconductor,  resistor,  IC,  solder  joint, 
connector). 

System/Equipment  A  group  of  units'  interconnected  or  assembled 

to  perform  some  overall  electronic  function 
(e.g.,  electronic  flight  control  system, 
communications  system). 

Unit  A  self-contained  collection  of  parts  and/or 

assemblies  within  one  package  performing  a 
specific  function  or  group  of  functions,  and 
removable  as  a  single  package  from  an 
operating  system  (i.e.,  autopilot  computer, 
vhf  communications,  transmitter). 


3.2  Acronyms 

3.2.1  Acronyms  used  In 

Procedure  A  of  Section  5 

Abbreviation 

Description 

AIC 

Airborne  Inhabited  Cargo 

AIT 

Airborne  Inhabited  Trainer 

AIB 

Airborne  Inhabited  Bomber 

AIA 

Airborne  Inhabited  Attach 

AIF 

Airborne  Inhabited  Fighter 

AUC 

Airborne  Uninhabited  Cargo 

AUT 

Airborne  Uninhabited  Trainer 

AUB 

Airborne  Uninhabited  Bomber 

AUA 

Airborne  Uninhabited  Attack 

AUF 

Airborne  Uninhabited  Fighter 

ARW 

Airborne  Rotary  Wing 

CL 

Cannon  Launch 

GB 

Ground  Benign 

GF 

Ground  Fixed 

GM 

Ground  Mobile 

ML 

Missile  Launch 

MFF 

Missile  Free  Flight 

MFA 

Airbreathing  Missile  Flight 

MP 

Manpack 

NS 

Naval  Sheltered 

NU 

Naval  Unsheltered 

NUU 

Naval  Undersea  Unsheltered 

NSB 

Naval  Submarine 

NH 

Naval  Hydrofoil 

SF 

Space  Flight 

USL 

Undersea  Launch 

3.2.2  Other  Acronyms 

Abbreviation 

Description 

BIT 

Built  In  Test 

CND 

Cannot  Duplicate 

COE 

Chance  Defective  Exponential 

ESS 

Environmental  Stress  Screening 

FRACAS 

Failure  Reporting  and  Corrective  Action 
System 

FL 

Fault  Location 

FMEA 

Failure  Mode  &  Effect  Analysis 

FBT 

Functional  Board  Tester 

ICT 

In  Circuit  Tester 

ICA 

In  Circuit  Analyzer 

mtTjf 

Mean  Time  Between  Failures 

MLE 

Maximum  Likelihood  Estimate 

NFF 

No  Fault  Found 

PPM 

Parts  Per  Million 

PWA 

Printed  Wiring  Assembly 

PM 

Performance  Monitoring 

RTOK 

Retest  OK 

TAAF 

Test  Analyze  &  Fix 
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4.  General  Guidelines 


4.1  Relation  of  ESS  to  Reliability  Program  Tasks.  Planning  an  ESS  program 
for  the  production  phase  is  interrelated  with  many  of  the  MIL-STD-785 
reliability  program  tasks  which  are  required  to  be  performed  during 
develop*, ent  and  production.  Every  effort  should  be  made  to  Integrate  the 
knowledge  gained  from  MIC -STD-78.)  tasks  Into  the  planning  of  an  ESS  program 
for  production.  Mr.-STD-78b  reliability  program  tasks  which  have  a 
particular  bearing  on  f.SS  planning  include:  Reliability  Prediction  (Task 
203),  Allocation  (Task  202),  Qualification  Tests  (Task  303),  Parts  Control 
(Task  207),  Failure  Reporting  Analysis  and  Corrective  Action  System  (Task 
104),  Failure  Modes  and  Criticality  Analysis  (Task  204),  Reliability 
Growth  Testing  (Task  302),  and  of  course,  ESS  (Task  301).  Proper  screen 
selection  and  placement  is  highly  dependent  on  the  reliability  and  stress 
design  characteristics  of  the  equipment.  information  derived  from 
reliability  program  tasks  such  as:  predicted  and  demonstrated  failure 
rates,  quality  level  of  parts,  number  and  type  of  nonstandard  and  M I L - 
parts,  number  and  type  of  interconnections,  design  capabi  ity,  field 
stress  environments,  and  critical  items  should  be  u$<?d  in  structuring  an 
ESS  program  for  production. 

4.2  Contractual  Aspects  of  ESS.  ESS  must  remain  an  adaptive  process  so 
that  the  screening  regimen  can  be  changed  to  improve  cost-effectiveness. 
Contract  provisions  for  ESS  programs  should  have  flexibility  to  affect 
necessary  modification  of  stress  screens.  During  the  initial  stages  of 
production  more  severe  stress  screens  may  be  required.  As  the  product  and 
process  mature,  the  screens  may  require  adjustment  such  as  by  reducing  the 
number  of  temperature  cycles,  the  number  of  axes  of  vibration  or  by 
eliminating  unnecessary  screens.  In  early  production,  a  number  of 
unknowns  precludes  adoption  of  optimum  stress  screening.  Some  of  the  more 
significant  unknowns  are: 

9  residual  design  deficiencies 

•  manufacturing  planning  errors 


•  worker  training 
0  new  suppliers 

0  latent  defects  in  new  part  lots 
0  new  process  capability 
0  stress  screening  effectiveness 
0  testability  (for  defect  detection) 

The  stress  screening  program,  even  if  carefully  planned,  may  produce 
unexpected  results  which  should  be  addressed  through  modification  of  the 
screens.  The  principle  of  adaptive  screening  is  to  adjust  the  screens  on 
the  basis  of  observed  screening  results  so  that  the  screens  are  always  most 
cost  effective.  Contract  terms  should  be  flexible  enough  to  permit 
modification  of  screens  or  screen  parameters  when  such  modification  can  be 
shown  to  be  beneficial. 

In  long  term  production  the  quantity  and  distribution  of  latent 
defects  change  with  time  and  therefore  contract  terms  should  contain 
provisions  for  periodically  reassessing  the  Individual  screens  and  the 
overall  screening  program.  The  overriding  criterion  for  change  should  be 
the  most  cost  effective  achievement  of  objectives.  Contracting 

arrangements  should  be  made  which  permit  such  changes  without  -having  to 
resort  to  extensive  renegotiation. 

4.3  Subcontractor  and  Supplier  Stress  Screening.  Items  which  are 
furnished  by  subcontractors  or  other  equipment  suppliers  may  require 
stress  screening.  There  are  several  distinct  advantages  for  the 
subcontractor  cr  supplier  to  perform  the  stress  screening  rather  than  the 
prime  contractor. 

(a)  Subcontractor/supplier  concern  for  yield  can  be  translated  to 
profits  which  may  force  process  improvements  to  minimize  latent 
defects. 


(b)  Screening  at  receiving  Inspection/test,  by  the  prime  contractor, 
may  Involve  returning  defective  Items  to  the  subcontractor/suppller 
and  result  In  shortages  and  schedule  slippages. 


(c)  Special  stress  screening  facilities  and  test  equipment  do  not  have 
to  be  purchased,  supported  and  operated  by  the  prime  contractor. 


The  procedures  and  methodology  contained  In  the  Guidebook  can  be 
Imposed  on  the  subcontractor/supplier.  To  assure  that  the 
subcontractor/supplier  Is  able  to  perform  the  tasks  required  by  the 
guidebook,  the  Intent  must  be  made  known  prior  to  production.  In  this 
manner,  the  subcontractor/suppl ler  can  prepare  a  screening  plan,  acquire 
the  necessary  capability  or  arrange  for  an  external  laboratory  to  perform 
the  screening. 


4.4  Costs  of  ESS  vs  Productivity  Improvement.  The  costs  of  conducting  a 
screening  program  during  the  production  phase  can  be  high.  To  a  large 
extent,  the  costs  can  be  offset  by  the  Increased  productivity  which  results 
through  proper  screen  selection  and  placement.  Screening  at  the  lowest 
possible  level  of  assembly  will  always  be  the  least  costly  alternative  In 
terms  of  rework  costs.  The  time  and  effort  required  to  test,  troubleshoot 
and  repair  Items  Increase  by  at  least  an  order  of  magnitude  at  each 
subsequent  level  of  assembly.  Significant  cost  savings  or  avoidance  can 
accrue  to  the  manufacturer  by  analyzing  the  cost  benefits  of  various  screen 
selection  and  placement  alternatives  and  by  striving  to  find  defects  at  the 
lowest  possible  level  of  assembly.  Cost  savings  to  the  Government  will 
result  through  Improved  field  reliability  and  corresponding  reductions  In 
field  repair  costs.  The  benefits  of  a  properly  conducted  ESS  programs  to 
the  Government  go  beyond  field  repair  costs  alone.  Improved  reliability 
during  early  life  will  also  reduce  over-buying  of  spares,  since  estimates 
of  required  spare  quantities  are  based  upon  early  life  field  performance. 
The  opportunity  for  introducing  new  defect  sources  Into  the  hardware 
during  field  maintenance  and  handling  Is  also  reduced. 
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There  should  be  however,  controls  and  constraints  on  the  cost  of 
conducting  a  screening  program.  Situations  can  arise  where  the  cost  of 
conducting  a  screening  program  far  outweigh  any  benefits  which  may  be 
derived.  For  example,  for  low  complexity  Items  the  number  of  screenable 
defects  which  are  likely  to  be  present  in  the  hardware  may  be  relatively 
small.  Conducting  a  full-scale  screening  program,  in  such  cases,  can 
result  in  very  high  costs  per  defect  eliminated.  Cost  of  $1  OK  to  $1 5 K  per 
defect  eliminated  may  be  justified  for  equipments  which  are  used  In 
critical  missions  with  very  high  reliability  requirements.  On  the  other 
hand,  such  costs  may  be  difficult  to  justify  if  the  equipment  Is  used  In 
noncritical  missions  and  if  the  costs  of  field  maintenance  are  not  severely 
affected  by  not  screening.  Each  case,  where  a  stress  screening  program  is 
under  consideration,  must  be  judged  individually  as  to  the  cost  benefits  to 
be  derived  from  stress  screening.  Procedure  D,  in  Section  5  of  the 
Guidebook,  is  used  to  determine  the  cost-effectiveness  of  ESS  programs. 

4.5  Air  Force  R&M  2000  ESS  Policy-Part  Fraction  Defective.  Air  Force  R&M 
2000  ESS  policy  requires  that  the  manufacturing  process  begin  with  piece 
parts  having  a  remaining  part  fraction  defective  below  1000  PPM  (parts  per 
million)  by  FY87  and  below  100  PPM  by  FY90.  ESS  results  from  first 
assembly  screens  are  used  In  the  Guidebook  procedures  to  evaluate  the 
achivement  of  these  goals.  In  terms  of  the  reliability  of  delivered 
systems,  the  R&M  2000  ESS  requirements  can  be  extended  to  include  goals  on 
remaining  part  fraction  defective  for  the  system  at  delivery.  Appendix  B 
of  the  Guidebook  discusses  a  method  which  uses  a  50  PPM  part  fraction 
defective  goal  for  delivered  systems  to  establish  quantitative  ESS  program 
goals. 

4.6  Part  vs  Assembly  Fraction  Defective.  The  part  fraction  defective  can 
have  a  significant  Impact  on  the  assembly  fraction  objective  depending 
upon  the  number  of  parts  contained  In  the  assembly.  The  Poisson 
approximation  is  used  In  Figure  4.1  to  illustrate  the  expected  assembly 
fraction  defective  as  a  function  of  the  remaining  part  fraction  defective 
and  the  number  of  parts  per  assembly. 


FIGURE  4.1.  FRACTION  OF  DEFECTIVE  ASSEMBLIES  vs  REMAINING  PART  FRACTION  DEFECTIVE 


As  can  be  noted  relatively  small  values  of  part  fraction  defective 
result  In  large  values  of  assembly  fraction  defective  depending  upon  the 
number  of  parts  contained  In  the  assembly.  As  an  example,  for  a  150  part 
assembly  containing  parts  with  a  fraction  defective  of  .01  (10,000  PPM), 
the  defect  density  Is  1.5  and  the  assembly  fraction  defective  Is  about  .8. 

In  terms  of  yield  only  about  20<  of  such  assemblies,  when  subjected  to 
first  assembly  test,  would  pass  without  failure.  It  is  quite  obvious  that 
the  part  fraction  defective  must  be  much  better  than  .01  if  the  costs  of 
rework,  retesting  and  handling  of  the  assemblies  are  to  be  avoided. 
Elimination  of  defectives  through  part  level  screening  is  obviously  the 
most  cost  effective  course  of  action.  However,  the  following  questions  can 
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be  posed:  How  much  better  must  the  remaining  part  fraction  defective  be?; 
What  level  of  part  fraction  defection  is  needed  for  delivered  systems?;  and 
Can  such  levels  be  achieved?  A  part  fraction  defective  of  .001  (1000  PPM) 
on  a  300  part  assembly,  results  in  an  assembly  fraction  of  about  .27. 
Although  not  shown  in  Figure  4.1,  a  part  fraction  defective  of  .001  (1000 
PPM)  on  a  1000  part  assembly  or  on  a  10,000  part  system  gives  an  assembly/ 
system  fraction  defective  of  .63  and  .99995  respectively.  The  foregoing 
implies  that  for  the  1000  part  assembly,  an  average  of  37  out  of  100 
assemblies  would  be  defect  free  and  for  the  10,000  part  system  only  about  5 
systems  in  100,000  would  be  defect  free.  Extending  the  same  example  to  the 
case  where  the  part  fraction  defective  is  .0001  (100  PPM),  then  an  average 
of  99  of  100,  1000  part  assemblies  would  be  defect  free  and  for  the  10,000 
part  system  an  average  of  37  out  of  100  systems  would  be  defect  free.  It 
would,  therefore,  appear  that  levels  of  part  fraction  defective  of  less 
than  100  PPM  are  needed  or  should  at  least  be  established  as  goals  for 
delivered  systems.  The  degree  to  which  such  goals  can  be  achieved  is 
dependent  upon  the  emphasis  placed  on  finding  defects  during  screening  and 
eliminating  their  cause(s)  through  corrective  action.  A  method  for 
establishing  goals  on  remaining  defect  density  at  delivery,  which  is 
discussed  in  Appendix  B,  uses  a  50  PPM  goal  on  part  fraction  defective  for 
each  system  delivered  to  the  field. 

4.7  Part  Level  Screen ing/Rescreeninq.  Screening  at  the  part  level  is  the 
most  cost  effective  alternative  for  eliminating  defects  prior  to  the  parts 
being  assembled  into  the  production  hardware.  A  population  of  parts,  even 
those  procured  to  high  quality  levels,  may  appear  to  contain  inordinately 
high  fraction  defective  levels  when  the  parts  are  retested.  For  example, 
microelectronic  devices  procured  to  the  quality  requirements  of  MIL-STD- 
883  receive  100%  final  electrical  testing  by  the  part  manufacturer.  None¬ 
theless,  one  manufacturer  has  found  that  about  1%,  and  as  much  as  4%  of  the 
parts  will  not  pass  a  similar  electrical  test  performed  at  the 
manufacturer's  receiving  inspection.  There  are  several  possible  reasons 
for  this  including: 


•  the  seller's  and  buyer's  tests  are  different 

•  seller  testing  errors 

•  buyer  testing  errors 

•  device  damage  or  degradation  In  handling 

•  inspection  and  sorting  errors. 

Table  4.1  shows  the  percent  rejected  for  a  large  quantity  of  devices 
which  were  subjected  to  rescreening  at  the  equipment  manufacturers  fa¬ 
cility.  The  data  indicate  that  the  remaining  part  fraction  defective  (per 
cent  rejected  column)  after  the  initial  screening  was  done  by  the  part 
vendor,  is  clearly  unacceptable.  However,  as  Is  typical  with  such  data, 
it  is  not  known  whether  the  parts  are  truly  of  poor  quality  or  whether 
testing  errors  or  handling  damage  could  be  the  cause. 


Table  4.1  Manufacturer  Receiving  Inspection  Test  Results. 


Part  Type 

Quantity 

— 

Average 

Quality 

Rejects 

Per  Cent  ! 

Rejected  j 

Microcircuits 

Discrete  Semiconductors 
Passives 

1,419,581 

343,000 

1.296,200 

8-1 

Tx 

ER-M 

13,779 

2,008 

8,539 

0 . 97 '9706PPM' 
0.59'5?54PPM'> 

o.es'esssppM' 

Reference  2.2.1 


The  quantities  of  remaining  defects  in  a  population  of  screened  or  re¬ 
screened  parts  Is,  at  best,  uncertain.  Screens  and  tests  are  not  perfect 
and  If  a  lot  of  parts  are  subjected  to  a  series  of  screens,  rescreens  and 
tests,  on  a  100%  basis,  the  observed  fraction  defective  does  not  provide 
Information  on  the  remaining  fraction  defective.  In  fact,  poor  screens  and 
tests  will  indicate  very  low  observed  part  fraction  defectives.  Part  level 
screening  should  result  In  a  remaining  part  fraction  defective  of  at  least 
.01%  (100  PPM)  to  avoid  costly  rework  during  manufacture  and  to  ensure 
adequate  reliability  in  the  product.  Most  statistical  sampling  plans 
contain  provisions  which  establish  average  outgoing  quality,  but  the 
assumption  underlying  such  plans  is  that  the  screens  and  tests  are  100% 
effective. 


To  determine  the  fraction  of  Incoming  microcircuit  test  rejects  that  were 
actually  defective,  another  manufacturer  performed  a  retest  of  525  rejects 
from  a  population  of  75,981  tested  devices.  The  results  are  shown  in  Table 
4.2. 

Table  4.2  Results  of  Retesting  Incoming  Receiving  Test  Microcircuit  Rejects 


Supplier 

V  cf  1 
Lois 

Total 

Qty. 

— 

Rejects 

Verified 

(See  Note) 

Total 

x 

Pass 

Tair  ' 

ITail 

1 

A 

i 

25  » 

8525 

100 

l.V 

62 

32 

0.38 

c 

6  ! 

8435 

22 

.26 

15 

7 

0.08 

C 

i  *> 

21826 

166 

.7o 

120 

46 

0.21  | 

l) 

30 

27295 

144 

.53 

35 

102 

0.37  | 

i 

2: 

9471 

96 

1.01 

31 

63 

0.67  i 

r 

2  i 

i 

429 

. 

6 

1.40 

2 

0.47  j 

TOTALS 

104 

75.981 

534 

0.70 

267 

256 

0. 34  • 

Reference  2.2.1 


::OTE :  S2S  of  the  S34  rejects  were  retested.  Percent 
failed  shown  in  last  column  is  the  percent  of 
the  total  quantity  tested. 


As  can  be  noted,  about  50%  of  the  rejects  were  found  to  be  defective  but 
50%  could  not  be  verified  as  rejects  l.e.  they  passed  the  retest.  Such 
large  discrepancies  can  be  the  result  of  any  one  or  a  combination  of  the 
reasons  listed  above.  On  a  lot  basis,  other  data  show  that  about  75-80% 
of  the  lots  subjected  to  rescreening  show  zero  failures  and  only  5%  of  the 
lots  produce  90-95%  of  the  failures.  These  data  suggest  that  the 
differences  are  traceable  primarily  to  lot  problems  and  very  likely,  would 
be  found  to  correlate  with  chronic  problems  specific  to  particular  device 
types  or  manufacturers.  Corrective  action  for  specific  problems  should  be 
determined  rather  than  resorting  to  retesting  of  reasonably  defect-free 
lots  with  the  attendant  possibility  of  handling  damage  or  testing  errors. 
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Screening  at  the  assembly  level  is  a  costly  means  of  finding  and 
eliminating  part  defects  from  the  hardware.  There  are  always  uncertain¬ 
ties  as  to  whether  the  part  defects  which  are  found  during  assembly  level 
screening  are  escapes  from  part  level  screens,  or  whether  they  are  newly 
introduced  defects  due  to  handling,  test  and  assembly  operations.  The 
part  fallout  from  early  screening  at  the  assembly  level  can  provide  much  of 
the  information  needed  for  resolving  such  uncertainties  and  taking  cor¬ 
rective  action.  If  the  part  fallout  at  assembly  level  screening  is  greater 
than  1000  PPM,  at  most,  then  rejection  of  suspect  lots,  changing  vendors, 
or  negotiation  of  corrective  action  with  the  part  vendors  should  be  made. 
A  thorough  failure  analysis  of  the  part  fallout  from  assembly  level 
screening  can  help  in  determining  the  types  of  screens  which  should  be 
used,  at  the  part  level,  for  eliminating  specific  defect  types. 


4.8  Development  Phase  Screening.  Screening  during  the  development  phase 
is  primarily  intended  as  an  experimental  activity  to  gather  information  on 
the  quantity  and  type  of  defects  likely  to  be  present  in  the  production 
hardware  and  the  effectiveness  of  screens  which  might  be  applied.  When  the 
development  hardware  is  similar  to  the  production  configuration,  the 
knowledge  gained  from  screen  experimentation  can  be  invaluable  for  coping 
with  the  problem  during  production.  However,  the  development  hardware 
can,  in  some  instances,  be  an  advanced  development  model  in  which  a  techni¬ 
cal  concept  is  being  validated  and  the  hardware  used  bears  little  re- 
serrfclance  to  the  production  hardware.  In  addition,  for  some  high  volume 
production  programs,  a  production  engineering  phase  (PEP)  may  follow  de¬ 
velopment  in  which  major  hardware  design  changes  are  made  to  enhance  pro- 
duclbility.  Suppliers  and  vendors  used  during  development  may  also  change 
for  production.  The  system  may  contain  miriy  nonstandard  parts  substituted 


due  to  lead  time  problems.  Screening  fallout  data  for  nonstandard  parts 
would  not  be  representative  of  production.  It  would  also  be  difficult  to 
obtain  a  measure  of  workmanship  or  process  latent  defects  because  the 
hardware  may  have  been  fabricated  in  engineering  laboratories. 
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In  addition,  experience  has  shown  that  about  one-half  of  development  phase 
failures  are  design  related.  The  lack  of  disciplined  electrostatic  dis¬ 
charge/electrical  overstress  (ESD/EOS)  controls  can  result  in  failures 
during  development  testing,  which  may  not  occur  under  more  controlled 
production  conditions.  The  combination  of  one  or  more  of  these  conditions 
during  development  will  tend  to  overshadow  information  needed  for  planning 
a  production  screening  program.  It  may  therefore  be  somewhat  unrealistic 
to  expect  that  accurate  screening  data  can  be  derived  from  some  development 
phase  screening  for  use  in  production  planning. 

4.9  ESS  Experimentation  -  Pre-Froduction  Prototypes.  Use  of  the  proce¬ 
dures  contained  in  the  guidebook  in  conjunction  with  stress  screen  experi¬ 
mentation  on  pre-production  prototype  equipment  can  provide  invaluable 
data  for  planning.  Estimates  of  the  type  and  quantity  of  defects  likely  to 
be  present  in  the  hardware  can  be  evaluated  against  experimental  data. 
Screens  can  be  designed  based  upon  engineering  evaluation,  which  provide 
the  desired  stess  stimulation  for  suspected  defect  sites  in  the  hardware. 
Test  specifications  can  also  be  evaluated  to  ensure  that  possible  failure 
modes,  arising  from  various  defect  types  and  sources,  can  be  detected  by 
the  tests  performed  either  during  or  following  the  screens.  Integration  of 
the  results  from  the  MIL-STD-785  reliability  program  tasks  can  also  be 
effectively  accomplished.  Early  fallout  from  screens  provides  the  maximum 
amount  of  information  on  likely  defect  sources  and  process  capability. 
Corrective  actions  taken  as  a  result  of  screen  experimentation  during 
development  can  aid  significantly  in  stabilizing  the  process  for  produc¬ 
tion.  In  addition,  planning  estimates  of  incoming  density,  screening 
strength  and  test  detection  efficiency  can  be  refined  as  a  result  of 
experimenting  with  stress  screens. 

4.10  Planning  a  Stress  Screening  Program  for  the  Production  Phase.  Plan¬ 
ning  a  stress  screening  program  for  production  must  begin  early  in  the 
developn^nt  phase.  The  success  of  a  stress  screening  program  is  strongly 
dependent  on  knowledge  of  the  product  and  the  processes  to  be  used  in 
manufacture.  The  following  must  be  kept  in  mind  when  planning  a  stress 
screening  program  using  quantitative  methods. 


•  The  defects  which  can  potentially  reside  in  the  product  and  the 
effectiveness  of  screens  in  precipitating  the  defects  to  failure  are 
not  known  with  certainty.  By  comparison  of  planned  estimates  for 
defect  fallout  with  actual  screen  fallout,  the  screening  and 
manufacturing  process  can  be  adapted  to  achieve  desired  goals. 

•  Screening  experience  data  on  equipment  similar  in  composition, 
construction  and  degree  of  maturity,  can  provide  very  useful  data  for 
planning  purposes.  Information  derived  from  the  following  sources 
should  be  used  In  planning  an  ESS  program  for  production. 

a.  Identification  of  hardware  Items  (parts,  assemblies)  which 
have  exhibited  a  high  incidence  of  latent  defectives  on  other 
programs. 

b.  Identification  of  suppliers/vendors  whose  products  have 
indicated  high  defect  levels. 

c.  Qualification  test  results. 

d.  Supplier  acceptance  test  results. 

e.  Part  receiving  inspection,  test  and  screening  results. 

f.  Screening  and  test  records  for  previous  programs. 

g.  Reliability  growth  test  results. 

•  A  viable  screening  program  must  be  dynamic,  l.e.  the  screening 
process  must  be  continuously  monitored  to  ensure  that  It  ^s  both 
technically  and  cost  effective.  Changes  to  the  screening  process 
should  be  made,  as  necessary,  based  on  analysis  of  screening  fallout 
data  and  failure  analysis  so  that  quantitative  screening  objectives 
can  be  achieved. 
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The  basic  questions  which  must  be  addressed  in  planning  a  stress 
screening  program  are: 

a.  What  are  the  quantitative  objectives  of  the  program? 

b.  What  are  the  stress  screens  to  be  used  and  what  level  of  assembly 
should  the  screens  be  placed  to  achieve  the  desired  objectives? 

c.  What  are  the  costs  associated  with  each  of  the  possible 
alternative  screening  sequences  and  how  can  the  screening  program 
be  made  cost  effective? 

d.  How  will  one  know  if  the  screening  program  is  proceeding  according 
to  plan?  What  assurances  can  be  provided  that  program  objectives 
have  been  achieved? 

e.  What  corrective  actions  must  be  taken  to  achieve  desired  screening 
program  goals  if  the  screening  fallout  data  Indicate  significant 
departures  from  the  planned  program? 

These  questions  are  each  addressed  through  use  of  the  procedures  in  Section 
5  of  the  Guidebook. 

Planning  an  ESS  program  for  the  production  phase  includes  the 
following  major  tasks: 

t  Establishing  Objective/Goals 

•  Obtaining  Initial  Estimates  of  Defect  Density 

•  Selection  and  Placement  of  Screens 

•  Preparation  of  Production  ESS  Plan 

A  discussion  of  each  of  these  major  tasks  which  includes  background, 
rationale  and  general  guidelines  for  use  of  the  detailed  procedures  is 
contained  in  the  following  Sections  4.10.1  -  4.10.5. 


4.10.1  Establishing  Goals/Objectives.  Expressed  quantitatively,  the 
objective  or  goal  of  a  stress  screening  program  is  to  reduce  the  incoming 
defect  density  in  a  production  lot  of  equipment  to  an  acceptable  remaining 
defect  density  in  a  cost  effective  manner.  Methods  discussed  in  Appendix  B 
provide  the  basis  for  establishing  goals  on  remaining  defect  density.  A 
set  of  sample  calculations  of  remaining  defect  density  Is  shown  in  Table 
4.3,  as  a  function  of  the  specified  or  predicted  failure  rate  (XQ)  in 
failures  per  operating  hour. 


Table  4.3  Remaining  Defect  Density  Goals  (DR) 


A  simple  relation  for  obtaining  goals  for  remaining  defect  density  is  to 
multiply  the  predicted  or  specified  failure  rate  XQ  for  the  system  by  100. 

100  X0  =PR 

The  remaining  defect  density  0R  is  directly  related  to  yield,  i.e.  DR  =  -In 
yield.  Yield  or  DR  is  the  goal  at  which  planning,  monitoring  and  control¬ 
ling  the  screening  process  is  aimed. 


4.10.2  Obtaining  Planning  Estimates  of  Defect  Density.  The  design  of  a 
stress  screening  program  requires  knowledge  of  the  quantity  and  type  of 
defects  which  are  likely  to  reside  in  the  prior  to  assembly  level 
screening.  The  part  fraction  defective  tables  contained  in  Procedure  A  of 
Section  5  of  the  Guidebook  are  used  to  obtain  planning  estimates  of  defect 
density.  Values  in  the  tables  are  based  upon  studies  of  historical  defect 
data  from  the  factory  and  field  for  several  part  types.  Extrapolations  to 
other  part  types  and  field  environments  were  made  based  upon  correlations 
to  MIl-HDBK-217  quality  level  and  field  environment  factors.  As  more 
experience  data  on  part  fraction  defective  are  gathered  the  estimates  will 
be  improved.  Study  results  and  methodology  are  contained  in  reference 
2.2.2. 


4.10.2.1  Latent  vs  Patent  Defects.  A  common  understanding  of  the  nature 
of  the  defects  which  the  screening  program  should  be  designed  to 
precipitate,  is  essential  for  proper  planning.  The  factors  which  impact 
incoming  defect  density  and  the  rationale  for  the  procedures  used  in 
obtaining  planning  estimates  of  defect  density  should  also  be  understood. 
As  will  be  shown,  there  can  be  no  precise  definition  of  the  term  "defect". 

In  a  simple  context,  a  defect  can  be  defined  in  terms  of  an  out-of¬ 
tolerance  or  specification  condition  which  can  be  readily  detected  by  an 
inspection  or  test  procedure.  Such  defects  are  termed  patent  defects. 
Patent  defects  represent  the  majority  of  the  defect  population  in  an 
equipment  and  are  readily  detected  without  the  need  for  stress  sc-eens.  A 
smaller  percentage  of  defects  however,  cannot  be  detected  by  conventional 
means.  Such  defects  are  termed  latent  defects.  Latent  defects  are 
characterized  as  an  inherent  or  induced  weakness  or  flaw  in  a  material 
which  will  manifest  as  an  early  or  premature  failure  in  the  operational 
environment. 
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Both  patent  and  latent  defects  are  introduced  into  the  product  during 
fabrication,  assembly,  handling  and  test  operations.  The  patent  defects 
pass  through  various  assembly  stages  until  they  are  detected  by  a  test  or 
inspection  of  sufficient  thoroughness  and  are  subsequently  eliminated  from 
the  product.  When  good  quality  control  test  and  inspection  procedures  are 
applied,  all  but  the  most  subtle  patent  defects  should  be  detected  and 
eliminated  prior  to  shipment.  Some  examples  of  patent  defects  are: 

Patent  Defects 

•  Parts 

-  Broken  or  damaged  in  handling 

-  Wrong  part  installed 

-  Correct  part  installed  incorrectly 

-  Failure  due  to  electrical  overstress  or  to  electrostatic 
discharge 

-  Missing  parts 

•  Interconnections 

-  Incorrect  wire  termination 

-  Open  wire  due  to  handling  damage 

-  Wire  short  to  ground  due  to  mlsrouting  or  Insulation  damage 

-  Missing  wire 

-  Open  etch  on  printed  wiring  board 

-  Open  plated  -  through  hole 

-  Shorted  etch 

-  Solder  bridge 

-  Loose  wire  strand 

Latent  defects  cannot  be  detected  until  they  are  transformed  to  patent 
defects  by  environmental  stress  applied  over  time.  Stress  screening  is  the 
vehicle  by  which  latent  defects  are  transformed  into  detectable  failures. 
S<*ne  examples  of  latent  defects  are: 
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Latent  Defects 

•  Parts 

-  Partial  damage  through  electrical  overstress  on  electrostatic 
discharge 

-  Partial  physical  damage  during  handling 

-  Material  or  process  Induced  hidden  flaws 

-  Damage  inflicted  during  soldering  operations  (excessive  heat) 

•  Interconnections 

-  Cold  solder  joint 

-  Inadequate/excessive  solder 

-  Broken  wire  strands 

-  Insulation  damage 

-  Loose  screw  termination 

-  Improper  crimp 

-  Unseated  connector  contract 

-  Cracked  etch 

-  Poor  Contact  termination 

-  Inadequate  wire  stress  relief 

4.10.2.2  Categories  of  Defects.  The  majority  of  parts  and  connections 
within  an  electronic  equipment  are  "good"  and  will  never  fall  over  the 
product's  lifetime.  The  failures  which  occur  during  product  life  are 
traceable  to  design  or  externally  Induced  causes,  or  to  latent  defects 
which  were  introduced  into  the  product  during  manufacture.  Not  all  latent 
defects  however,  are  screenable  i.e.,  capable  of  being  removed  from  the 
equipment  in  the  factory  by  use  of  stress  screens.  It  is  only  those  latent 
defects,  whose  failure  thresnold  can  be  accelerated  by  the  stresses 
imposed  by  the  screens,  which  are  screenable.  Such  screenable  defects,  If 
not  removed  from  the  product  in  the  factory,  result  In  pren.ature  or  early- 
life  failures  in  the  field.  It  is  the  screenable  early  life  fa^ure  which 
the  stress  screening  program  must  be  designed  to  remove.  Figure  4.2 
illustrates  the  categories  of  defects  and  their  relationship  to  product 
life  failures. 
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Figure  4 .2  Defect  Categories  l  Product  Life  Failures 

4.10.2.3  Factors  Which  Impact  Defect  Density.  The  quantity  and  type  of 
defects  which  are  Introduced  into  a  product  are  dependent  upon  several 
factors.  The  first  five  factors,  listed  be^w,  are  related  to  product  or 
program  characteristics  for  which  the  manufacturing  function  within  a 
company  has  little  control.  The  last  two  factors  are  related  to  the 
manufacturing  process  for  which  the  product  manufacturer  has  direct 
control . 

a.  Complexity  -  The  quantity  and  type  of  parts  and  interconnections 
used  in  the  product  effects  defect  density.  Increased  complexity 
creates  more  opportunities  for  defects. 
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b.  Part  Quality  Level /Grade  -  The  quality  levels  of  parts  are 
established  by  Mil-Std  part  screening  requirements.  The  number  of 
defects  which  remain  In  a  lot  of  screened  parts  Is  determined  by  the 
type  and  extent  of  screening  and  testing  to  which  the  parts  are 
subjected  under  Mil-Std  screening  requirements. 

c.  Field  Stress  Environment  -  The  stress  conditions  to  which  the 
equipment  will  be  exposed  In  the  field  environment  will  affect  the 
proportion  of  defects  which  should  be  screened  from  the  product.  A 
defect  may  be  precipitated  to  early  failure  in  a  harsh  field  operating 
environment,  but  may  survive  product  life  in  a  benign  field 
environment. 

d.  Process  Maturity  -  New  production  requires  time  to  identify  and 
correct  planning  and  process  problems,  train  personnel  and  to 
establish  vendor  and  process  controls.  Maturity  is  dependent  on 
volume  and  time.  Low  production  volume  over  a  long  period  would  have 
a  low  maturity  rate  and  will  thus  Impact  defect  density. 

e.  Packaging  Density  -  Electronic  assemblies  with  high  part  and 
wiring  density  are  more  susceptible  to  process,  workmanship  and 
temperature  Induced  defects  due  to  smaller  error  margins.  Increased 
rework  difficulty  and  thermal  control  problems. 

The  following  factors  are  under  the  direct  control  of  the 
manufacturer.  The  degree  of  control  exercised  will  determine  defect 
density.  Screen  fallout  data  provide  the  necessary  input  for  determining 
out-of-cimtrol  conditions. 

f.  Manufacturing  Process  Controls  -  Good  process  controls  will  tend 
to  reduce  the  number  of  defects  which  are  introduced  into  the  product. 
The  criteria  by  which  processes  are  considered  to  be  In  or  out  of 
control  should  be  established  by  reliability  requirements  and 
monitored  using  the  fallout  from  the  screening  process. 


9-  Workmanship  Quality  Standards  -  Stringent  and  properly  enforced 
workmanship  quality  standards  will  enhance  the  reliability  of  the 
product  through  reduced  introduction  of  workmanship  defects  into  the 
product.  The  levels  to  which  quality  standards  should  be  established 
and  monitored  must  also  be  dictated  by  reliability  requirements  and 
made  visible  by  the  screening  process. 

4.10.2.3.1  Relationship  of  Part  Fraction  Defective  to  Quality  Level.  The 
number  of  defects  which  reside  in  electronic  hardware  is  strongly 
dependent  on  the  MIL-STD  quality  level  of  the  parts  used.  An  example, 
using  microcircuit  quality  grades  is  presented  to  illustrate  ideas.  The 
failure  rate  of  different  populations  of  microcircuits,  operating  under 
identical  conditions,  can  vary  over  an  order  of  magnitude  depending  on 
quality  level  (e.g.  Class  S  versus  C-l).  Major  differences  between  the 
Class  S  die  and  the  class  C-1  die  include  the  visual  inspection  acceptance 
criteria,  level  of  process  controls,  extent  of  screening  and  the 
electrical  tests  to  which  the  dies  are  subjected.  Since  screens  and  tests 
do  not  make  devices  more  reliable  (they  improve  lot  quality  by  eliminating 
some  latent  defective  parts),  a  "good"  class  C-l  die  Is  as  "good"  as  a 
class  S  die.  Perhaps  this  can  be  extended  to  "good"  class  D-l  die  as  well. 
Therefore,  it  can  be  postulated  that  the  difference  in  the  failure  rate  of 
the  two  populations  due  solely  to  quality  level.  Is  also  a  direct  measure 
of  the  difference  in  fraction  defective  of  those  populations. 

To  extend  the  example,  consider  a  class  S,  hermetic  flatpack  MSI  device 
of,  say,  40  gates  operating  with  T.  =25°C  In  a  benign  ground  environment. 
A  failure  rate  of  0.0032  x  10  ®  failures  per  hour  is  calculated  using  MIl- 
HDBK-217.  Let  5,000  of  such  deviqes  be  used  In  an  end  item  expected  to 
operate  50,000  hours.  The  expected  number  of  device  failures  during  the 
end  item  life  is  less  than  1.  For  this  application,  the  device  can  be 
considered  to  be  "good",  i.e.  free  of  latent  defectives.  If  a  class  C-l 
device  were  used  on  the  end  item  instead  of  the  class  S  device,  an 


additional  20  failures  could  be  expected  to  occur  during  the  same  end  item 
life,  due  solely  to  the  difference  in  quality  grade.  The  additional  20 
failures  can  be  viewed  as  representing  latent  defectives  in  the  popula¬ 
tion.  If  the  class  S  parts  were  operated  with  Tj  =100°C  Instead  of  25°C 
the  increase  in  failure  rate  would  result  In  an  additional  two  failures 
during  the  50,000  hours.  This  may  indicate  that  the  class  S  lot  contains 
latent  defectives  that  were  precipitated  by  the  increased  operating 
temperature.  There  can  be  no  precise  definition  for  a  latent  defective 
part  because  the  inherent  flaw  can  range  from  a  minor  flaw  ( which  may  not 
be  subjected  to  sufficient  stress  to  cause  degradation  of  the  flaw  to  a 
hard  failure)  to  a  major  flaw,  which  requires  only  a  slight  stress.  One 
view  is  that  if  a  part  fails  during  the  life  of  the  end  item  in  which  it 
resides  it  is,  by  definition,  a  latent  defective  part  (excluding  wearout, 
design  or  externally  induced  failures).  The  quality  level  of  the  parts, 
used  in  a  product  is  a  major  factor  affecting  incoming  defect  density. 
Procedure  A,  in  Section  5  of  the  Guidebook  uses  the  quality  level  as  a 
factor  in  obtaining  planning  estimates  of  defect  density. 

4.10.2.3.2  Screenable  Latent  Defects  and  the  Field  Stress  Environment. 
The  notion  of  screenable  latent  defects  must  be  further  examined  to  fully 
understand  the  rationale  used  for  the  procedures  contained  in  the  Guide¬ 
book.  The  population  of  latent  defects  within  newly  manufactured 
electronic  items  can  be  viewed  as  a  continuum  which  ranges  from  minor 
defects  of  small  size  to  major  defects  of  large  size.  Defects  of  large 
size  will  tend  to  fail  prematurely  under  normal  field  operating  stress 
conditions.  Defects  of  small  size  will  either  eventually  manifest  as 
failures,  or  not  fail  at  all  during  product  life.  It  is  the  major  flaw  or 
defect  which  stress  screening  is  Intended  to  precipitate  to  failure.  Good 
manufacturing  process  controls  will  tend  to  reduce  the  number  of  latent 
defects  which  are  Introduced  into  the  hardware.  However,  it  is  Important 
to  note  a  somewhat  controversial  point,  i.e.,  given  the  same  manufacturing 
process,  the  number  of  screenable  latent  defects  which  may  reside  In  the 
hardware  will  differ,  dependent  upon  the  operating  environment  to  which 
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the  equipment  will  be  exposed.  The  stress/time  to  which  a  latent  defect  is 
exposed  will  determine  its  tlme-to-fai lure  or  failure  threshold.  The 
failure  threshold  for  a  defect  in  a  harsh  environment  will  differ  from  the 
same  defect  in  a  benign  environment.  To  illustrate.  Figure  4.3  shows  that 
a  harsh  uninhabited  airborne  environment  has  a  smaller  time-to-failure 
than  a  ground  benign  environment  thus  affecting  the  proportion  of  a  latent 
defect  population  which  should  be  screened  from  the  equipment. 
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Figure  4.3  Defects  and  the  Field  Stress  Environment 


Obtaining  an  initial  estimate  of  defect  density  for  an  equipment  must  take 
into  consideration  the  field  operating  environment  to  which  the  equipment 
will  be  exposed  during  product  life.  The  methods  contained  in  Procedure  A 
of  Section  5,  use  the  environments  of  MIL-HDBK-2 1 7  (Il£  Factors!  as  a  defect 
density  estimation  factor. 
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4,10.2.3.3  Process  Maturity  and  Defects.  The  maturity  of  both  the  product 
design  and  the  manufacturing  process  can  significantly  impact  the  quantity 
and  type  of  defects  which  can  reside  in  the  hardware.  The  data  shown  in 
Table  4.4  represent  experience  on  several  large  development  and  production 
projects.  As  the  data  illustrate,  the  proportions  of  failures  in  a  product 
which  are  traceable  to  design,  part  or  manufacturing  causes  can  differ 
substantially,  depending  upon  the  stage  of  maturity  of  the  product  and  the 
manufacturing  process.  During  the  development  phase,  the  major 
contributor  to  product  failure  is  design  (~50%),  while  parts  may  account 
for  20%  of  the  failures.  Unfortunately,  design  problems  can  still  be 
present  in  the  product  when  stress  screens  are  being  conducted  during 
production.  The  proportion  of  failures  in  a  product,  attributable  to 
design,  would  be  expected  to  decrease  as  the  process  matures.  As  can  be 
noted,  part  and  workmanship  problems  tend  to  dominate  early  and  late 
production.  The  overall  defect  density  in  the  product  would  also  be 
expected  to  decrease  as  the  process  matures.  Maturity  of  the  product  and 
process  should  be  taken  into  account  when  planning  estimates  of  defect 
density  are  being  determined  in  accordance  with  the  Procedure  A  of  Section 
5.  In  such  cases,  the  user  may  decide  to  modify  some  of  the  incoming  part 
fraction  defective  values  in  Tables  5.2  through  5.13,  of  Procedure  A  either 
upward  or  downward,  depending  upon  past  experience  and  assessments  of 
maturity. 


Table  4.4  Defect  Types  &  Density  vs  Process  Maturity 


Maturity 

Defect 

Type  Distribution  (percent! 

Defect 

Design 

Manufacturing 
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Density 
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MM 
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Reference  2.2. 1 


4.10.2.3.4  Packaging  Density.  Assemblies  with  high  part  and  wiring 
density  are  more  likely  to  contain  both  patent  and  latent  defects  because 
of  the  proximity  of  devices  and  interconnections  contained  within  a  small 
volume.  The  effects  of  poor  heat  dissipation  in  densely  packaged 
electronic  assemblies  can  introduce  latent  defects.  Difficulties  in 
initially  assembling  or  reworking  the  hardware  can  also  make  such 
assemblies  more  defect  prone.  Procedure  A  in  Section  5,  for  estimating 
defect  density,  does  not  directly  take  into  account  the  packaging  density 
factor.  It  is  recommended  however,  for  those  assemblies  in  an  equipment 
which  are  judged  to  have  high  packaging  density,  that  the  tabled  values  of 
part  fraction  defective  be  increased  in  accordance  with  the  manufacturer's 
experience. 

4.10.3  Screen  Selection  and  Placement  The  singular  most  important  task  in 
planning  a  stress  screening  program  is  the  selection  of  appropriate 
screens  and  their  placement  at  various  levels  of  assembly  so  as  to  achieve 
a  cost  effective  screening  program.  Listed  below  are  the  factors  which 
affect  screen  selection  and  placement.  Each  of  the  factors  are  discussed 
in  more  detail  in  following  sections. 

a.  Goals  on  Remaining  Defect  Density  -  The  extent  of  screening 
required  during  the  production  phase  will  depend  on  MTBF  requirements 
and  on  the  goals  established  for  remaining  defect  density  (Dp). 

b.  Incoming  Defect  Density  -  The  quantity  and  type  of  defects  which 
reside  in  the  hardware  at  various  assembly  levels  effects  the  type  and 
extent  of  screening  required. 

c.  Screen  Effectiveness  -  Prior  knowledge  of  the  effectiveness  of  the 
screens  in  precipitating  defects  to  failure. 

d.  Test  Detection  Efficiency  -  The  tests  which  can  be  economically 
and  feasibly  used  to  detect  defects  which  have  been  precipitated  to 
failure  by  the  screens. 


e.  Thermal  and  Vibration  Response  Characteristics  -  The  structural, 
thermal  and  material  properties  of  the  items  to  be  screened  and  their 
response  to  applied  stress. 

f.  Design  Limits  -  The  environmental  stress  design  limits  of  the 
items  to  be  screened. 

g.  Facilities  -  The  screening,  test  and  instrumentation  facilities 
available  to  the  manufacturer  to  perform  screening  and  test 
operations. 

h.  Costs  -  The  costs  to  achieve  screening  program  goals  on  remaining 
defect  density. 

i.  Failure-Free  Acceptance  Tests  (FFAT)  -  The  use  of  a  FFAT  as  an 
integral  part  of  a  system  level  screen  to  verify  that  goals  have  been 
achieved. 


4.10.3.1  Goals  on  Remaining  Defect  Density  Equipments  having  high 
reliability  requirements  will  have  more  stringent  goals  on  remaining 
defect  density  and  consequently  increased  screening  emphasis  is  needed. 
Methods  for  determining  goals  on  remaining  defect  density  are  discussed  in 
Appendix  3.  Achieving  low  defect  densities  may  require  100%  screening  at 
all  assembly  levels  and  use  of  a  failure-free  acceptance  screen/test  at  the 
system  level  to  provide  assurance  that  goals  have  been  achieved. 

4.10.3.2  Incoming  Defect  Density.  A  production  program  which  begins  with 
high  levels  of  incoming  defect  density  will  require  more  extensive 
screening  to  reduce  the  defect  density  to  acceptable  levels.  Every  effort 
should  be  made  to  determine  realistic  estimates  of  incoming  defect  density 
based  upon  the  manufacturers  experience  and  use  of  the  procedures 
contained  in  the  Guidebook. 
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4.10.3.3  Screen  Effectiveness.  Screen  effectiveness  is  characterized  as 
the  "screening  strength"  which  is  defined  as:  the  probability  that  a 
screen  will  precipitate  a  defect  to  a  detectable  state  given  that  a  defect 
susceptible  to  the  screen  stress  is  present.  A  basic  premise  of  stress 
screening  is  that  under  specific  screening  stresses  applied  over  time,  the 
failure  rates  of  defectives  are  accelerated  from  that  which  would  occur 
under  normal  field  operating  stress  conditions.  By  subjecting  electronic 
items  to  accelerated  stresses,  i.e.  rapid  temperature  cycling  and  random 
vibration,  latent  defects  are  thus  precipitated  to  early  failure.  More 
severe  stresses  will  tend  to  accelerate  failure  mechanisms  and  the  rate  of 
defect  failure.  For  example,  the  failure  rate  of  a  latent  defect  increases 
with  more  rapid  rates  of  temperature  change  and  larger  temperature 
extremes.  The  screening  strength  of  a  random  vibration  screen  increases  as 
a  function  of  the  level  and  duration  of  the  applied  excitation. 

Stress  screens  are  not  all  equally  effective  in  transforming  latent 
defects  into  detectable  failures.  The  nature  of  defects  varies  with 
equipment  type,  manufacturer  and  time.  Screen  effectiveness  is  achieved 
through  proper  application  of  screens  which  can  only  be  realized  through 
prior  experience  and  experimentation.  Stress  screens  are  intended  to 
precipitate  latent  part  and  workmanship  defects.  In  a  very  broad  sense, 
vibration  screens  are  considered  to  be  more  effective  for  workmanship 
defects  and  thermal  screens  are  considered  more  effective  for  part 
defects.  There  are  also  classes  of  defects  which  are  responsive  to  both 
vibration  and  thermal  excitation.  Table  4.5  provides  a  listing  of  latent 
defect  types  and  the  screens  believed  to  be  effective  is  precipitating  them 
to  failure.  Table  4.5  may  be  used  as  an  aid  in  the  selection  of  a  screen 
type  when  prior  knowledge  on  workmanship  or  part  defects  for  similar 
assemblies  is  available. 
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Table  4.5  Assembly  Level  Defect  Types  Precipitated 
by  Thermal  and  Vibration  Screens' 


Oefect  Type  Oetected 

Thermal  Screen 

Vibration  Screen 

Defective  Part 

X 

X 

Broken  Part 

X 

X 

X 

X 

Solder  Connection 

X 

X 

PCB  etch,  Shorts  and  Opens 

X 

X 

Loose  contact 

X 

Wire  Insulation 

X 

Loose  wire  termination 

X 

X 

Improper  crimp  or  mating 

X 

Contamination 

X 

Oebris 

X 

Coose  hardware 

X 

Chafed,  pinched  wires 

X 

Parameter  drift 

X 

Hermetic  seal  failure 

X 

Adjacent  boards/parts  shorting 

X 

Table  4.5  indicates  that  vibration  screens  are  generally  more 
effective  for  loose  contacts,  debris  and  loose  hardware  while  temperature 
cycling  screens  are  not  effective.  Thermal  screens  are  generally  more 
effective  for  part  parameter  drift,  contamination  and  improper  crimp  or 
mating  type  defects  while  vibration  screens  are  not.  For  other  defect 
classes  listed  in  the  table,  both  thermal  and  vibration  screens  are 
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effective,  but  the  relative  degree  of  effectiveness  of  one  screen  type  over 
the  other  is  not  precisely  known.  These  are  some  of  the  uncertainties 
which  must  be  dealt  with  in  planning  a  screening  program.  Historically,  on 
average,  20*  of  the  defects  are  found  to  be  responsive  to  vibration  screens 
and  80*  to  temperature  cycling  screens.  (Reference  2.2.4). 

4.10.3.3.1  Pre/Post  Screen  Testing  and  Screen  Effectiveness.  In  order  to 
experimentally  determine  scress  screen  effectiveness,  the  following 
conditions  are  required: 

a.  The  items  subjected  to  stress  screening  must  be  tested  thoroughly 
before  the  stress  screen  to  assure  that  no  detectable  failures  remain 
at  the  start  of  stress  screening.  When  testing  is  not  performed  prior 
to  stress  screening,  it  is  not  known  whether  patent  defects  were 
present,  which  could  have  been  detected  without  stress  screening  or 
whether  latent  defects  were  precipitated  by  the  stress  screen. 

b.  The  items  subjected  to  stress  screening  must  be  powered  and 
exercised.  Performance  must  be  continuously  monitored  to  assure  that 
stress-dependent  defects  (e.g.,  intermittents,  temperature  and  timing 
sensitive  faults)  are  detected. 

c.  The  items  subjected  to  screening  must  be  tested  using  the  same 
test(s)  both  before  and  after  the  stress  screen  to  assure  that  the 
failures  detected  are  a  result  of  the  stresses  imposed. 

d.  Data  must  be  collected  on  defect  fallout  after  the  stress  screen 
( 1  - e. ,  during  subsequent  stress  screens,  tests,  or  early  field 
operation)  to  obtain  an  estimate  of  the  number  of  defects  which  were 
initially  present. 
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When  such  data  are  available,  the  screen  effectiveness  can  then  be  de¬ 
termined  by  use  of  the  observed  fallout  from  the  screen  and  the  number  of 
defects  Initially  present  i.e. : 


Screening  Strength  a 


Fallout 


#  of  Initial  Defects 


If  the  screen  effectiveness  was  known  precisely  then  the  number  of  incoming 
defects  could  be  calculated  directly  using  the  observed  fallout  from  the 
screen.  The  remaining  number  of  defects'  would  also  be  known.  Such 
idealized  conditions  are  difficult  to  realize  in  practice.  We  are  thus 
compelled  to  use  a  modeling  approach  where  screen  effectiveness  (strength) 
is  based  upon  estimates  derived  from  a  combination  of  the  actual  screening 
program  data,  experiments,  and  the  published  literature.  The  screening 
strength  models  and  values  used  in  the  guidebook  tables  of  Procedure  B  in 
Section  5,  were  developed  using  such  an  approach.  The  results  and 
methodology  used  for  these  studies  are  contained  in  references  2.2.1, 
2.2.2.  Additional  information  is  also  provided  in  references  2.2.6  and 
2.2.9.  As  more  experience  data  on  stress  screening  are  gathered,  the 
screening  strength  estimates  will  be  refined  and  improved. 


4.10.3.3.2  Pre  and  Post  Screen  Testing  During  Production.  As  was  pre¬ 
viously  discussed,  if  an  item  is  not  tested  prior  to  entering  a  screen  It 
cannot  be  determined,  even  if  a  detailed  failure  analyses  were  performed, 
whether  the  defects  were  precipitated  by  the  screen  or  whether  they  were 
present  in  the  item  (patent  defects)  before  the  screen.  Testing  items 
before  they  enter  the  screens  and  establishing  that  the  items  are  function¬ 
ing  properly  is  essential.  Evaluation  and  measurement  of  the  effectiveness 
of  the  screens  and  the  overall  screening  process  should  be  based  upon  only 
those  defects  which  are  precipitated  to  failure  by  the  stressed  imposed  by 
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the  screen.  Pre-screen  testing  should  be  done  immediately  prior  to  the 
screen  to  eliminate  the  uncertainties  of  latent  defect  introduction  during 
such  processes  as  cleaning,  conformal  coating  and  handling  which  may 
otherwise  follow  the  pre-screen  test.  Relaxing  pre-screen  test 
requirements  for  economic  reasons  can  be  detrimental  to  achieving  program 
objectives.  If  major  changes  take  place  during  production  such  as  in  an 
assembly  or  fabrication  process,  personnel  or  production  flow,  then  the 
defect  density  (both  latent  and  patent)  is  likely  to  change  and  affect  the 
fallout  observed  during  screening.  Under  long  term  production,  process 
improvements  and  other  corrective  actions  taken  as  a  result  of  the 
screening  process  are  likely  to  change  the  quantity  and  distribution  of 
latent  defects  present  in  the  hardware.  Workmanship  and  manufacturing 
process  defects  tend  to  dominate  early  production  and  part  related  defects 
dominate  mature  production.  Screens  have  a  different  degree  of 
effectiveness  for  different  defect  types  and  therefore  screens  which  may 
have  been  effective  during  early  production  should  be  re-evaluated  to 
ascertain  their  effectiveness.  Without  the  use  of  pre-screen  testing, 
evaluation  and  control  of  the  screening  process  is  not  possible. 

1.10.3,3.3  Screen  Parameters.  Screening  strength  and  the  failure  rate  of 
defects  are  a  function  of  specific  screen  stresses  (parameters)  and  the 
time  duratior  of  the  stress  application.  Tables  5.14  thru  5.U-  in 
Procedure  B  of  Section  5  provide  values  for  screening  strength  and  oefect 
failure  rates  as  a  function  of  relevant  screening  parameters.  Temperature 
cycle,  constant  temperature,  random  and  swept-sine  screening  parameters 
are  defined  as  follows: 

(A)  Thermal  Cycle  Screen  Parameters 

1.  Maximum  Temperature  (Tmax)  -  The  maximum  temperature  to  which  the 
screened  assembly  will  be  exposed.  Th is  should  noi  exceed  tne  lowest  of 
the  maximum  ratings  of  ail  the  parts  and  materials  comprising  the  assembly. 
Note  that  nonoperating  temperature  ratings  for  parts  are  higher  than 
operating  ratings. 
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2.  Minimum  Temperature  (Tmin)  -  The  minimum  temperature  to  which  the 
screened  Item  will  be  exposed.  This  should  not  exceed  the  highest  of  the 
minimum  ratings  of  all  the  parts  and  materials  comprising  the  assembly. 

3.  Range  (R)  -  The  range  is  the  difference  between  the  maximum  and 
minimum  applied  external  (chamber)  '  temperature  (Tmax  -  Tmin). 
Tenperatures  are  expressed  In  °C. 

4.  Temperature  Rate  of  Change  (T)  -  This  parameter  Is  the  average  rate 
of  change  of  the  tenperature  of  the  item  to  be  screened  as  it  transitions 
between  Tmax  and  Tmin  and  is  given  by: 


Where:  t-j  is  the  transition  time  from  Tmin  to  Tmax  in  minutes 

t^  is  the  transition  time  from  Tmax  to  Tmin  in  minutes 


5.  Dwell  -  Maintaining  the  chamber  temperature  constant,  once  it  has 
reached  the  maximum  (or  minimum)  tenperature,  Is  referred  to  as  dwell. 
Dwell  at  the  temperature  extremes  may  be  required  to  a 1 1 c  /  the  item  being 
screened  to  achieve  the  chamber  temperature  at  the  extremes.  The  duration 
of  the  dwell  Is  a  function  of  the  thermal  mass  of  the  item  being  screened. 
For  assemblies  which  have  low  thermal  mass,  part  case  temperatures  will 
track  chamber  tenperatures  closely  thereby  eliminating  the  need  for  dwell. 
Units  and  systems  may  have  a  greater  thermal  lag  arid  achieving  high  rates 
of  tenperature  change  may  be  difficult.  Dwells  at  tenperature  extremes  are 
required  in  such  instances. 


6.  Number  of  Cycles  -  The  number  of  transitions  between  temperature 
extremes  (Tmax  or  Tmin)  divided  by  two. 

(B)  Constant  Temperature  Screen  Parameters 

1.  Temperature  Delta  (  ^  T1  -  The  absolute  value  of  the  difference 
between  the  external  (chamber)  temperature  at  which  the  equipment  is  being 
screened  and  25°C. 

A  T  =  T  -  25°C 

Where  T  is  the  external  chamber  temperature 

2.  Duration  -  The  time  period  over  which  the  external  temperature  is 
applied  to  the  item  being  screened,  in  hours. 

(C)  Vibration  Screen  Parameters 

1.  qrms  level  for  Random  Vibration  -  The  rms  value  of  the  applied 
power  spectral  density  over  the  vibration  frequency  spectrum. 

2.  g-level  for  Swept  Sine  Vibration  -  The  constant  acceleration 
applied  to  the  equipment  being  screened  throughout  the  frequency  range 
above  40Hz>  The  g-level  below  40HZ  may  be  less. 

3.  Duration  -  The  time  period  over  which  the  vibration  excitation  is 
applied  to  the  item  being  screened,  in  minutes. 

4.  Axes  of  Vibration  -  This  can  be  a  single  axis  or  multip'e  axes 
depending  on  the  sensitivity  of  defects  to  particular  axial  inputs. 
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4.10.3.4  Test  Detection  Efficiency.  Test  detection  efficiency  Is  a 
measure  of  test  coverage  and  Is  defined  as  a  characteristic  of  a  functional 
or  operational  test  vrfilch  is  measured  by  the  ratio  of  failure  modes  detect¬ 
able  by  the  test  to  the  total  number  of  possible  failure  modes.  While 
stress  screens  may  be  effective  in  transforming  a  defect  Into  a  detectable 
failure,  removal  of  the  failed  condition  Is  dependent  on  the  capability  of 
the  test  used  to  detect  and  localize  the  failure. 

Modern  electronic  equipment  comprised  of  microprocessors,  large  memory 
and  LSI  devices  may  contain  defects  so  subtle  that  only  the  most  thorough 
of  tests  can  detect  them.  Printed  wiring  assemblies  (PWA)  have  also  become 
much  more  complex  with  associated  higher  defect  densities.  The  costs  of 
PWA  fault  isolation  and  repair  at  end  Item  test  and  during  field  use  can  be 
10-100  times  greater  than  at  the  PWA  level.  Stress  screening  and  testing 
at  the  PWA  level  even  perhaps  at  the  bare  board  level,  thus  becomes  more 
cost  effective.  Investments  In  test  equipment  and  in  developing  thorough 
tests  with  high  test  detection  efficiency  also  becomes  practical  from  an 
economic  standpoint. 

Care  should  be  taken  to  ensure  that  tests  have  detection  efficiencies 
as  high  as  Is  technically  and  economically  achievable.  The  screens  may 
otherwise  precipitate  defects  to  failure  which  may  go  undetected  by  post 
screen  tests.  Effective  screening  at  lower  levels  of  «.ss.'n.bly  may  not 
always  be  easily  accomplished  because  of  low  detection  efficiency.  The 
difficulty  in  accurately  simulating  functional  interfaces  or  the  inability 
to  establish  meaningful  acceptance  criteria  may  make  the  development  of 
tests  with  high  detection  efficiency  at  the  assembly  level  very  costly.  A 
certain  percentage  of  defects  may  only  be  detectable  at  the  unit/system 
level  when  all  or  a  majority  of  the  system  components  are  connected  and 
operating  as  a  system.  Analysis  and  quantification  of  test  detection 
efficiencies  should  be  an  Integral  part  of  the  planning  for  a  screening 
program. 


4.10.3.4.1  Determining  Test  Detection  Efficiency.  On  some  system  pro-  s 

curements  the  probability  of  detection  Is  a  specified  parameter  for  built- 
in-test  (BIT),  performance  monitoring  (PM)  and  fault  location  (FL)  capa¬ 
bility  requirements.  When  the  required  BIT  or  PM/Ft  capability  is  used  to 
verify  performance  of  an  item  being  screened,  the  specified  values  of 
detection  efficiency  should  be  used  in  developing  the  screening  plan.  On 
other  system  procurements,  requirements  to  perform  a  failure  ntodes  and 
effects  analysis  (FMEA)  are  specified  in  the  contract.  In  such  cases,  the 
FMEA  should  be  used  to  estimate  the  fraction  of  failure  modes  detectable 
for  a  given  test  design. 

When  FMEA  or  BIT  fault  detection  requirements  are  not  specified  in  the 
contract,  estimates  of  test  detection  efficiency  should  be  made  based  upon 
experience  data.  The  data  should  be  gathered  from  fixed  test  positions  and 
analyzed  by  test  engineering  personnel.  Table  4.6  provides  values  of  test 
detection  efficiency  for  various  tests  which  may  be  applied  with  stress 
screens.  The  values  in  the  table  were  derived  by  production  and  engineer¬ 
ing  test  personnel  from  a  large  000  electronic  system  manufacturer.  (Ref¬ 
erence  2.2.1).  j 

TABLE  4.6  DETECTION  EFFICIENCY  vs  TEST  TYPES 


Level 

Assembly 

Test  Type 

Detection 

11 f 1c lency 

Production  Line  GO-NO  GO  Test 

0.85 

Assembly 

Production  Line  In-Circuit  Test 

0.90 

High  Performance  Automatic  Tester 

J 

0.95 

_ 

Performance  Verification  Test  (PVT) 

0.90 

Unit 

factory  Checkout 

0.95 

final  Acceptance  Test 

0.98 

On-Line  Performance  Monitoring  Test 

0.90 

System 

factory  Checkout  Test 

0.95 

- - — — 

Customer  Final  Acceptance  Test 

0.99 

Table  4.7  provides  fault  coverage  estimates  for  various  automatic  test 
systems  used  by  electronics  system  manufacturers.  (Reference  2.2.8.) 


TABLE  4.7.  FAULT  COVERAGE  FOR  AUTOMATIC  TEST  SYSTEMS 


Circuit  Type 

Automatic  Test  System  Type  | 

loaded  Board 
Shorts  Tester 
(IBS) 

ln-CIrcult 
Analyzer 
( 1CA) 

ln-CIrcult 

Tester 

(1CT) 

,  functional  Board 
Tester 
(fBT) 

Digital 

ASX  to  65X 

50X  to  75X 

BSX  to  94X 

90X  to  98X 

Analog 

3SX  to  55X 

7 OX  to  9 2X 

9 OX  to  96X 

BOX  to  BOX 

Hybrid 

4 OX  to  SOX 

SOX  to  9 OX 

87X  to  94X 

83X  to  9SX 

♦Reference  2.2.8 

An  Illustration  of  fault  coverage  for  a  sample  of  1000  PWA's  subjected  to 
various  test  strategies  Is  also  provided  in  Reference  2.2.8.  The  strate¬ 
gies  employed  Include  the  use  of  each  of  four  automatic  testers 
independently  and  in  combination.  Table  4.8  provides  a  sunmary  of  the 
results. 

_ TABLE  4.8  FAULT  DETECTION  FOR  A  1000  PCB  LOT  SIZE* _ 

ICA- 

fault  1CT- 


Classification 

Actual 

IBS 

ICA 

ICT 

FBT 

1CA-1CT 

ICA-FBT 

ICT-FBT 

FBI 

Shorts 

261 

261 

261 

261 

261 

261 

261 

261 

261 

Opens 

Missing 

5 

5 

5 

5 

5 

5 

5 

5 

5 

Components 

Wrong 

30 

25 

28 

25 

29 

27 

29 

30 

Components 

Reversed 

67 

53 

61 

55 

64 

59 

60 

65 

Components 

?fl 

26 

23 

25 

27 

28 

25 

28 

Bent  leads 

Analog 

43 

38 

43 

43 

43 

43 

43 

43 

Specifications 

25 

13 

21 

18 

21 

21 

22 

23 

Digital  logic 

27 

20 

27 

20 

27 

27 

27 

Performance 

26 

26 

26 

26 

26 

Total  No. 

of  Faults 

512 

266 

421 

462 

486 

470 

497 

498 

508 

Fault  Coverage 
Fault  Coverage 

100% 

52% 

B2X 

90X 

95% 

92X 

97X 

97X 

99X 

Increase 

* 

- 

- 

* 

* 

2.2X 

2.3X 

2.5X 

4.51 

Rejected  PCBs 

398 

223 

345 

370 

385 

374 

391 

393 

394 

Rework  Yield 
Undetected 

195 

316 

354 

376 

361 

384 

388 

393 

Faulty  PCB 

203 

82 

44 

22 

37 

14 

10 

5 

Rework  Yield 
Rework  Yield 

49% 

79% 

89% 

94X 

91X 

96X 

97X 

99X 

Inc  rease 

- 

- 

- 

- 

- 

2X 

2. IX 

3.2X 

4.51 

Finished  Units 

80S 

918 

956 

978 

963 

986 

990 

995 

♦Reference  2.2.8 
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As  can  be  noted  from  the  table,  using  only  a  functional  Board  Tester 
(FBT)  provides  95%  fault  coverage  but  combining  an  In-Circuit  Tester  (ICT) 
with  the  FBT  Increases  coverage  to  97%  and  adding  an  In-Circuit  Analyzer 
(ICA)  to  the  sequence.  Increases  coverage  to  99%. 

The  faults  detected  are  typical  patent  defects  and  do  not  cover  the 
spectrum  of  defect  types  of  Interest  In  stress  screening.  The  statistics 
provided  In  the  table,  however,  provide  a  basis  for  developing  estimates  of 
test  detection  efficiency  when  a  stress  screening  program  Is  being 
planned.  The  data  should  also  be  helpful  In  selecting  test  strategies  for 
use  with  stress  screens. 

4.10.3.4.2  Power-On  Testing  vs  Power-Off.  Application  of  power, 
exercising  and  monitoring  equipment  performance  continuously  during  the 
screen  will  greatly  enhance  test  detection  efficiency.  Subtle  faults, 
such  as  contact  Intermlttents  or  temperature  sensitive  parts,  can  only  be 
detected  with  powered  and  monitored  screens.  With  the  Increased 
complexity  of  modern  electronics,  fault  sites  may  be  confined  to  smaller 
areas  and  fault  symptoms  may  appear  only  during  certain  tests  or  under  a 
special  set  of  external  conditions.  As  a  result,  a  greater  Incidence  of 
"Cannot  Duplicate"  (CND) ,  "No-Fault  Found”  (NFF)  and  "Retest  OK"  ( RTOK ) 
and  similar  Intermittent  or  transient  phenomena  can  occur.  Latent  defects 
which  are  precipitated  to  failure  by  stress  screens  can  be  categorized  Into 
three  general  types: 

Type  1  Physical  defects  that  are  readily  transformed  from  an 

Inherent  weakness  to  a  hard  failure  by  the  stress  screen. 

Type  2  Physical  defects  that  manifest  as  failures  only  while  under 
thermal  or  mechanical  stress,  (e.g.  Intermittent  caused  by  a 
cold  solder  Joint) 

Type  3  Functional  defects  that  manifest  as  performance  failures  or 
anomolles  only  while  under  thermal  or  mechanical  stress, 
(e.g.  timing  problems) 
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The  type  1  defects  are  readily  detected  by  post  screen  tests  of  sufficient 
thoroughness.  Type  2  and  Type  3  defects  require  thorough  and  continuously 
monitored  tests  so  that  they  can  be  detected.  Type  3  defects,  which 
include  problems  such  as  timing,  part  parameter  drift  with  temperature  or 
tolerance  build-up  can  only  be  detected  with  powered  and  monitored  tests. 
Type  2  and  Type  3  defects  can  comprise  50*  and  as  much  as  80*  of  the  latent 
defects  present  in  the  hardware.  (Reference  2.2.2) 

Developing  tests  and  test  strategies  for  use  with  stress  screens  and 
estimating  their  detection  efficiency  is  a  vitally  important  activity  in 
planning  a  stress  screening  program.  The  use  of  tests  with  high  detection 
efficiency  is  of  equal  Importance  to  using  effective  screens  in 
structuring  a  screening  program  for  production. 

4.10.3.5  Thermal  and  Vibration  Response  Characteristics.  All  assembled 
hardware  consists  of  many  paths  along  which  a  stress  might  be  transmitted. 
The  selection  of  screening  parameters  and  methods  of  stress  application 
must  be  suited  to  the  stress  transmission  characteristics  of  the  hardware 
design.  As  a  part  of  the  screen  selection  and  placement  process,  in  which 
thermal  or  vibration  screens  are  to  be  used,  a  stress  response  survey  of 
the  item  to  be  screened  should  be  performed.  Care  should  be  exercised  to 
ensure  that  hardware  responses  are  large  enough  to  generate  an  effective 
screen  while  not  exceeding  hardware  design  capability.  Environmental 
stresses  should  be  applied  to  the  hardware  and  the  response  of  critical 
hardware  elements  measured  to  determine  whether  maximum  or  minimum 
temperature  limits  are  being  exceeded,  and  whether  suspected  defect  sites 
(parts.  Interconnections  etc.)  are  responsive  to  the  screen  stress.  In 
addition,  normal  design  provisions  for  isolating  the  hardware  from  stress 
such  as  the  use  of  shock  mounting,  vibration  isolators  or  cooling  air 
should  also  be  evaluated.  Application  of  environmental  stress  screening 
In  such  instances,  should  require  bypassing  the  normal  stress  Isolation 
provisions  or  may  dictate  the  need  for  screening  at  lower  assembly  levels 
which  do  not  Include  the  stress  isolation  design  features. 


4.10.3.6  Design  Limits.  The  use  of  screen  parameters  which  impose 
stresses  which  exceed  the  design  limits  of  the  product  is  not  recommended. 
Effective  screening  programs  can  be  developed  without  having  to  resort  to 
stresses  which  exceed  the  design  capability  of  the  hardware.  Criteria  for 
judging  how  much  the  design  limits  can  be  safely  exceeded,  without  causing 
damage  to  the  product,  are  non-existent  or  at  least  arbitrary.  The  impetus 
for  exceeding  the  design  limits  Is  basically  economic  in  nature  because 
harsher  screens  tend  to  take  less  time  to  precipitate  defects  to  failure. 
Using  the  procedures  contained  in  the  Guidebook,  the  manufacturer  can 
focus  on  those  Items  in  which  defects  are  most  likely  to  reside  and  deter¬ 
mine  safe  screening  levels,  within  appropriate  cost  constraints,  for 
precipitating  them  to  failure. 

4.10.3.7  Facilities  and  Costs.  The  facilities  that  the  manufacturer  lias 
available  for  screening,  instrumenting  and  testing  the  product  affects 
screen  selection  and  placement.  A  manufacturer  may  not  have  random 
vibration  facilities  or  automatic  test  systems  which  can  be  used  for  the 
stress  screening  program.  In  such  cases,  the  manufacturer  may  decide  to 
impose  less  severe  stresses  for  a  longer  duration  or  decide  to  use  less 
expensive  alternatives  such  as  described  in  NAVMAT  P-9492.  The  costs  to 
purchase  expensive  screening  or  test  equipment  and  perform  screens  at  a 
given  level  of  assembly  may  not  be  warranted,  in  terms  of  the  number  of 
defects  which  are  likely  to  be  found.  The  screening  and  test  facilities 
which  the  manufacturer  has  available  for  screening  must  be  addressed  in 
preparing  the  screening  program  plan  and  In  the  screen  selection  and  place¬ 
ment  process.  Costs  versus  the  benefits  to  be  derived  from  screening 
should  be  addressed. 

The  criterion  used  In  the  guidebook  to  both  limit  costs  and  judge  the 
cost  effectiveness  of  the  screening  program  is  called  the  cost  threshold. 
The  cost  threshold  Is  based  upon  the  average  cost  of  repair  in  the  field 
and  can  be  viewed  as  a  "not-to-exceed"  cost.  After  determining  the  costs 
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of  conducting  the  screening  program  and  estimating  the  expected  fallout  in 
accordance  with  the  Procedures  B  &  C,  the  manufacturer  should  compare  the 
cost  per  defect  eliminated  against  the  cost  threshold.  If  the  cost  per 
defect  eliminated  is  found  to  be  higher  than  the  cost  threshold,  then  the 
manufacturer  should  determine  alternative  methods  which  lower  the  costs  of 
finding  and  eliminating  the  defects  to  a  value  which  is  less  than  or  equal 
to  the  cost  threshold.  Alternatives  might  Include  reducing  the  incoming 
defect  density  by  means  other  than  assembly  screening,  (e.g..  Increase  the 
quality  level  of  parts  used)  increase  the  screening  strength  at  lower 
assembly  levels,  or  eliminate  screens  which  may  be  of  questionable  value. 
In  those  cases  where  field  reliability  is  an  overriding  requirement, 
the  Government  procuring  activity  must  decide  to  what  extent  the  cost 
threshold  should  be  exceeded. 

4.10.3.8  Fai lure-F^ee  Acceptance  Screen/Test.  The  use  of  failure-free 
periods  or  cycles,  as  a  part  of  a  stress  screen,  is  intended  to  provide 
some  degree  of  assurance  for  the  user  that  screening  is  complete.  A 
failure-free  period  is  a  time  Interval  during  which  the  equipment  must 
operate  without  failure  while  exposed  to  environmental  stress.  Arbitrary 
selection  of  failure-free  periods  does  not  provide  any  quantitative 
assurance  that  the  remaining  defect  density  goals  have  been  achieved. 
Prior  knowledge  of  defect  density,  the  effectiveness  of  the  screens  to  be 
used,  and  a  quantitative  goal  for  the  remaining  defect  density  must  be 
available  in  order  to  establish  failure-free  acceptance  test  requirements. 
The  quantity  of  primary  interest  is  the  average  number  of  defects  remaining 
(defect  density)  per  equipment  at  delivery.  Yield,  which  Is  directly 
related  to  remaining  defect  density,  can  be  verified  by  conducting  a 
failure-free  screen/test  for  a  predetermined  period  of  time.  The  length  of 
the  failure-free  period  is  dependent  on  the  yield  requirement  or  goal,  the 
degree  and  type  of  stresses  applied  during  the  failure-free  period  and  the 
statistical  confidence  needed  to  provide  assurance  that  the  yield  goal  has 
been  achieved. 
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The  failure-free  acceptance  test  can  be  used  as  an  integral  part  of  the 
system  level  screen  or  as  part  of  a  formal  acceptance  test  for  the  system 
when  a  stress  screen  is  not  used  at  the  system  level.  When  a  failure-free 
acceptance  test  is  used,  each  system  offered  for  acceptance  must  be  sub¬ 
jected  to  the  failure-free  screen  and  test.  Passing  the  test  involves 
contiguous  operation  of  the  equipment  for  a  time  T,  without  failure  while 
under  screening  stress.  If  a  failure  occurs,  the  failure  is  repaired  and 
the  equipment  is  again  subjected  to  the  same  failure-free  period  starting 
at  TO.  Appendix  C  of  the  Guidebook  provides  the  mathematical  derivation 
of  the  FFAT  methods  contained  in  the  Guidebook.  Procedure  C  in  Section  5 
contains  the  detailed  procedures  for  tailoring  a  FFAT  to  program  require¬ 
ments. 

4.10.4  Preparation  of  ESS  Plans.  The  contractor  should  prepare  ESS  plans 
for  both  the  development  and  production  phases.  The  purpose  of  the  de¬ 
velopment  phase  plan  is  to  describe  the  proposed  application  of  ESS  during 
development  and  production.  The  development  phase  plan  should  be  submit¬ 
ted  as  part  of  the  Reliability  Program  Plan.  A  detailed  ESS  plan  should  be 
submitted  for  approval  by  the  procuring  activity  prior  to  production. 

4.10.4.1  Development  Phase  Plan  -  The  development  phase  plan  should  in¬ 
clude  the  following: 

a.  identification  of  the  reliability  requirements  for  the  product  and 
the  quantitative  goals  for  the  ESS  program. 

b.  Identification  of  the  equipment  to  be  screened  and  the  respective 
production  quantities. 

c.  description  of  the  initial  screens  which  will  be  applied  and  the 
screening  experiments  which  will  be  conducted. 

d.  description  of  the  data  collection  and  analysis  program  which  will 
be  used. 
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e.  description  of  subcontractor  and  supplier  stress  screening  to  be 
performed. 

f.  results  of  preliminary  use  of  the  Guidebook  procedures. 

g.  Identification  of  the  organization  elements  that  will  be 
responsible  for  ESS  planning  and  experimentation,  and  the  conduct  of 
development  phase  screening  activity. 


4.10.4.2  Production  Phase  Plan.  The  production  phase  plan  shall  Include 
the  following: 

a.  Quantitative  objectives  of  the  ESS  program. 

b.  Detailed  breakdown  to  the  assembly  level  of  the  equipment  which 
will  be  screened. 

c.  Description  of  the  screens  which  will  be  applied,  including  screen 
parameters  and  exposure  time. 

d.  Description  of  the  results  in  applying  Procedures  A,  B,  C  and  D  of 
the  Guidebook  including  the  rationale  for  achieving  quantitative 
objectives  In  a  cost  effective  manner. 

e.  Description  of  the  FRACAS  to  be  used  and  the  analyses  procedures 
which  will  be  used  to  evaluate  and  control  the  screening  process. 

f.  Description  of  the  Failure-Free  Acceptance  Test  to  be  performed 
for  each  system  to  verify  achievement  of  objectives. 


g.  Identification  of  the  organizational  elements  responsible  for 
conducting  and  evaluating  the  effectiveness  of  the  production  ESS 
program. 
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4,10.5  Guidelines  for  Initial  Screen  Selection  and  Placement.  An  initial 
screening  regimen  should  be  selected  for  experimental  use  during  the 
development  phase  in  conjunction  with  the  use  of  the  Guidebook  procedures. 
Table  4.9  is  recommended  as  an  aid  in  selecting  and  placing  screens  for  a 
starting  regimen. 


TABLE  4.9  GUIDELINES  FOR  INITIAL  SCREEN  SELECTION  AND  PLACEMENT 


Selection 

Placement 

Level 

of 

Assembly 

Temp 

Cycle 

Const. 

Temp. 

Rand 

Vib. 

i 

Advantages 

Disadvantages 

Assy 

m 

*2 

El 

m 

•  pre' 

lowest  (unpowered 
screens) 

e  Small  site  permits 
batch  screening 
e  Low  thermal  mass 
allows  high  rates 
of  temperature 
change 

e  Temperature  range 
greater  than  oper¬ 
ating  range 
allowable 

atlvely  low 
a  Test  equipment 
cost  for  powered 
screens  is  high 

E  •  Effective 

M  •  Marginally  Effective 

H  •  Not  Effective 

Notes: 

1.  Particularly  If  power 

Is  applied  and  perfor¬ 
mance  Is  monitored  at 
temperature  extremes. 

2.  Effective  where 
assemblies  contain  com¬ 
plex  devices  (RAMs.  micro¬ 
processors.  hybrids) 

3.  Effectiveness  highly 
dependent  on  assembly 
structure.  Not  effective 
for  small,  stiff  PWAs. 

Unit 

E 

M 

E 

m 

e  Relatively  easy  to 
power  and  monitor 
performance  during 
screen 

e  Higher  test  detec¬ 
tion  efficiency 
than  assembly 
level 

e  Assembly  inter¬ 
connections  (e.g.. 
wiring  backplane) 

are  screened 

•  Thermal  mass  pre¬ 
cludes  high  rates 
of  change,  or 
requires  costly 
facilities 
e  Cost  per  flaw 
significantly 
higher  than 
assembly  level 
e  Temperature  range 
reduced  from 
assembly  level 

System 

E 

M 

E 

IEH 

e  All  potential 
sources  of  flaws 
are  screened 
e  Unit  Interopera¬ 
bility  flaws 
detected 

e  High  test  detec¬ 
tion  efficiency 

e  Difficult  and 
costly  to  test  at 
temperature 
extremes 

e  Mass  precludes  use 
of  effective 
vibration  screens, 
or  makes  use 
costly 

•  Cost  per  flaw  1$ 
highest 
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4.11  Production  Phase  -  Monitoring,  Evaluation  and  Control.  Once  a 
screening  program  is  implemented  during  the  production  phase,  the  screen 
fallout  data  and  the  screening  process  must  be  monitored  and  controlled  to 
assure  that  program  objectives  are  achieved.  Use  of  a  Failure  Reporting 
Analysis,  and  Corrective  Action  System  (FRACAS)  should  be  an  integral  part 
of  production  phase  monitoring  and  control  tasks.  The  fallout  from  the 
screening  process  provides  the  necessary  visibility  regarding  the  sources 
of  defects  in  the  product  and  the  manufacturing  process.  Finding  defects, 
determining  their  root  causes  and  ensuring  that  the  sources  of  the  defects 
are  eliminated  from  either  the  process  or  product,  is  the  basic  mechanism 
by  which  process  capability  is  improved. 

Analyses  of  screen  fallout  data  must  be  performed  with  specific 
objectives  in  mind.  Well-defined  monitoring,  evaluation  and  control  task 
objectives  will  ensure  that  the  proper  data  is  collected,  classified  and 
correctly  analyzed  to  meet  objectives.  The  objectives  of  the  monitoring- 
evaluation  and  control  tasks  are  to  establish  assurance  that  remaining 
defect  density  and  reliability  goals  are  achieved  through  implementing 
improvements  in  manufacturing,  screening  and  test  process  capability. 
Manufacturing  process  capability  is  improved  through  taking  corrective 
actions  which  reduce  the  number  of  defects  that  are  introduced  into  the 
product.  Screening  process  capability  is  improved  by  increasing  the 
stress  or  duration  of  a  screen  and  ensuring  that  potential  sites  for 
defects  in  the  product  are  being  adequately  stimulated  by  the  screen. 
Testing  process  capability  is  improved  by  increasing  test  detection 
efficiencies  when  it  is  found  that  latent  defects,  precipitated  to  failure 
by  a  lower  level  screen,  are  escaping  and  being  detected  by  tests  at  upper 
assembly  levels. 

Another  goal  of  monitoring  and  control  tasks  is  related  to  cost 
effectiveness.  The  initial  screening  program  might  have  been  based  upon 
planning  astimates  which  were  overly  pessimistic.  Corrective  actions 
might  also  have  been  taken  during  production  to  reduce  the  number  of 
defects  introduced  into  the  product.  In  either  case,  if  the  screening 


program  is  continued  as  planned,  more  screening  than  is  necessary  results, 
which  inpacts  both  cost  and  schedule.  Decisions  must  oe  made  to  either 
reduce  the  screening  vegimen,  resort  to  screening  on  a  sample  basis  or  to 
completely  eliminate  the  screen.  In  a  sense,  the  goal  of  monitoring  and 
control  tasks  is  to  make  the  screening  program  unnecessary. 

4.11.1  Data  Collection.  The  importance  of  timely  and  accurate  data 
collection  to  achieving  screening  program  objectives  cannot  be  over¬ 
emphasized.  The  data  elements  listed  below  should  be  collected  during  the 
conduct  of  the  screening  program.  Some  of  the  data  elements  become 
available  directly  as  observed  events  from  the  screening  process..  Other 
data  elements  will  become  available  only  after  analysis  or  the  failures  and 
failure  data,  or  after  a  batch  of  items  have  been  exposed  to  screening. 

a.  Identification  of  the  Items  exposed  to  the  screen/test. 

b.  Number  of  like  items  exposed  to  the  screen/test. 

c.  Number  of  like  items  passed/failed  the  screen/test. 

d.  Description  of  the  type  of  defect  found  (part, 

workmanship/process,  design) 

e.  Type  and  number  of  defects  found  in  conjunction  with  the 
number  of  items  exposed,  passed/failed  (data  elements  b,  c,  d). 

f.  Identification  of  the  part,  interconnection  site  where  the 
defect  was  found. 

g.  Identification  of  the  assembly  level  or  manufacturing  process 
operation  where  the  defect  was  introduced. 

h.  Screen  conditions  under  which  the  defect  was  found  (e.g., 
high  temperature,  vertical  axis  of  vibration  etc.). 


i.  Tlme-to-failure  relative  to  the  start  of  the  screen. 

j.  Failure  analysis  results  which  identifies  the  root  cause  of 
the  defect. 

h.  Corrective  action  taken  to  eliminate  the  cause  of  the  defect 
from  the  product  and/or  process. 

4.11.2  Failure  Classification.  In  order  to  establish  a  basis  for  the 
analysis  of  the  screening  fallout  data,  the  failures  must  be  properly 
classified.  The  following  classification  scheme  is  recommended. 

a.  Part  Defect  -  A  failure  or  malfunction  which  Is  attributable  to  a 
basic  weakness  or  flaw  in  a  part  (diode,  transistor,  microcircuit, 
etc.). 

b.  Manufacturing  Defect  -  A  failure  or  malfunction  attributable  to 
workmanship  or  to  the  manufacturing  process  (cold  solder  joint, 
cracked  etch,  broken  wire  strands,  etc.). 

c.  Design  Failure  -  A  failure  or  malfunction  attributable  to  a  design 
deficiency.  Note  that  electrical  or  thermal  overstress  failures  due 
to  inadeguate  derating,  are  design  problems.  One  would  expect  that  all 
or  most  design  problems  would  have  been  eliminated  from  the  hardware 
prior  to  production.  Nonetheless,  a  substantial  proportion  of 
failures  during  early  production  (a/30/£)  are  found  to  be  traceable  to 
design. 

d.  Externally  Induced  Failures  -  A  failure  attributable  to  external 
influences  such  as  prime  power  disturbances,  test  equipment,  instru¬ 
mentation  malfunctions  or  test  personnel. 

e.  Dependent  Failure  -  A  failure  which  is  caused  by  the  failure  of 
another  associated  item  which  failed  independently. 


f.  Software  Failure  -  A  failure  attributable  to  an  error  In  a  computer 
program. 

g.  Unknown  Cause  Failure  -  An  independent  failure  which  requires 
repair  and  rework  but  which  cannot  be  classified  into  any  of  the 
above  categories. 

4.11.3  Preliminary  Analysis  of  Fallout  Data.  A  preliminary  analysis  of 
the  fallout  data  should  be  performed  to  insure  that  failure  causes  are 
properly  established  and  to  categorize  the  failures  so  that  more  detailed 
analysis  related  to  the  program  objectives  can  be  performed. 

a.  Part  and  Interconnection  Defects  -  All  failures  classified  as  part, 
board  and  interconnection  defects,  which  are  precipitated  and  detected  by 
a  screen/test,  should  be  considered  to  be  latent  defects  provided  that 
pre-screen  testing  was  performed.  These  data  should  be  used  for  monitoring 
and  control  purposes. 

b.  Design  Failures  -  A  predominance  of  design  problems  which  is 

discovered  during  production  screening  operations  is  a  matter  of  serious 
concern.  Every  effort  should  be  made  to  determine  corrective  actions  for 
design  problems  very  early  In  production.  It  does  no  good  to  speculate 
that  the  design  problems  should  have  been  eliminated  from  the  hardware 
during  the  development  stage.  Stress  screening,  on  a  100%  basis,  is  an 
expensive  and  time  consuming  method  for  finding  design  problems.  If  the 
fallout  from  screening  indicates  persistent  evidence  of  design  problems, 
methods  other  than  100%  stress  screening  should  be  used.  Reliability 

growth  and  Test-Analyze-And-F1x  (TAAF)  techniques  are  recommended. 

c.  Unknown  Cause  Failures  -  Special  attention  should  be  given  to 

unknown  cause  failures.  Sufficient  investigation  should  be  made  to 

establish  that  an  intermittent  condition  does  not  exist.  The  number  of 
failures  classified  as  "Unknown  Cause"  should  be  kept  to  a  minimum.  Every 
effort  should  be  made  to  correlate  the  failure  circumstance  data  with  the 
other  similar  failure  incidents,  as  w.'ll  as  to  use  failure  analysis  so  as 
to  establish  the  cause  of  failure. 


d.  Dependent  and  Induced  Failures  -  Analyses  of  dependent  and  induced 
failures  should  be  performed  to  determine  necessary  corrective  actions. 

4.11.4  Analysis  of  Screen  Fallout  Data.  The  analysis  of  screening  fallout 
data  Is  directed  toward  evaluating  the  screening  process  so  as  to  achieve 
screening  program  goals  on  remaining  defect  density  Dp.  Yield  goals  are 
achieved  by  both  Improving  manufacturing  process  capability  through 
corrective  action  and  by  Improving  the  screening  and  test  process 
capability  when  It  Is  found  to  be  needed. 

Manufacturing,  screening  and  test  process  capability  will  determine 
the  remaining  defect  density.  The  capability  of  these  processes  is 
measured  and  controlled  by  use  of  two  Important  quantities,  the  incoming 
defect  density  (DJN)  and  the  test  strength  (TS).  Neither  one  of  these 
quantities  is  directly  observable. as  a  result  of  the  screening  process. 
The  only  observable  statistic  Is  the  fallout  from  the  screen/test,  from 
which  Inferences  regarding  Djp  and  TS  must  be  drawn.  The  basic  approach 
used  In  the  Procedure  E  of  Section  5,  Is  to  obtain  estimates  of  D^  and  TS, 
using  the  screen  fallout  data  and  to  statistically  compare  the  observed 
data  against  the  planning  estimates.  Based  upon  the  comparisons, 
corrective  actions  are  determined  to  eliminate  the  source  of  the  defect 
from  the  process  and/or  to  change  the  screens  so  as  to  achieve  stated 
objectives. 

Four  complementary  procedures  are  presented  in  Procedure  E  for 
performing  monitoring  and  analyses  tasks.  Procedures  El  and  E4  use  Quality 
Control  Charts  and  control  Intervals  for  monitoring  and  control. 
Procedures  E2  and  E3  use  maximum  1  ike  1 1  hood  and  graphical  techniques, 
applied  to  the  Chance  Defective  Exponential  model,  to  estimate  DjN  and  TS. 


4.11.4.1  Quality  Control  Charts.  The  use  of  control  charts  for  defect 
control  Is  a  standard  quality  assurance  technique.  Control  charts  are  used 
in  Procedure  El  which  are  based  upon  the  Poisson  Probability  distribution; 
i.e.. 


P(X3x) 


e"°  0* 


x! 


Where:  0  =  defect  density 

x  =  number  of  defects  in  an  Item 

P(X-x)  =  probability  of  x  defects  In  an  item 

The  mean  of  the  Poisson  distribution  is  D  and  the  standard  deviation  isjD. 
99 %  control  limits  on  the  control  charts  are  established  by  D  -  The 

primary  purpose  of  the  control  chart  technique  Is  to  establish  baselines 
against  which  the  process  can  be  monitored  and  by  which  out-of -control 
conditions  can  be  Identified.  Part  fraction  defective  and  defect  density 
are  calculated,  using  the  fallout  data,  and  compared  against  the  control 
chart  baselines.  Part  and  workmanship  (process)  problems  are  rank  ordered 
and  corrective  actions  are  required  which  eliminate  the  source  of  the 
defects  from  the  product.  Procedure  El  of  Section  5  contains  the  detailed 
methodology  for  Implementing  the  control  chart  technique. 


4,11.4.2  Use  of  the  CPE  Model  to  Evaluate  Screening  Results.  The  Chance 
Defective  Exponential  (CDE)  model  was  developed  by  Fertlg  and  Muthy  and  Is 
discussed  In  a  paper  contained  In  the  1978  Annual  R&M  Symposium  (Reference 
2.2.7).  Appendix  A  of  the  guidebook,  provides  a  description  of  the  CDE 
model.  The  failure  rate  function  of  the  CDE  model  can  be  fitted  to  the 
observed  fallout  data  for  a  given  screen  so  as  to  obtain  estimates  of  the 
model  parameters.  The  parameters  of  the  CDE  model  provide  estimates  of  the 
Incoming  defect  density  DjN,  thescreenlng  strength  (SS)  and  the  failure 
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rate  of  the  "good"  part  population  for  an  equipment.  Figure  4.4  Is  an 
extract  from  study  report  (Reference  2.2.6)  which  shows  a  histogram  of  the 
screen  fallout  from  a  12  cycle  -54°C  to  71°C  temperature  cycle  screen. 
The  fallout  per  cycle  Is  used  to  obtain  maximum  likelihood  estimate  (MLE) 
for  the  parameters  of  the  CDE  model. 


Reference  2.2.6 


FIGURE  4.4  TEMPERATURE  CYCLING  OATA  FITTED  TO  THE  CHANCE  DEFECTIVE 

EXPONENTIAL  MODEL 


As  the  figure  shows,  the  CDE  model  parameters  estimated  by  the  MLE 
procedure,  are:  incoming  defect  density  (D^)  equal  to  .1542  defects  per 
item,  the  failure  rate  of  a  defect  (Xp)  equal  to  .1485  failures  per  hour 
(which  corresponds  to  a  screening  strength  of  .95)  and  a  value  of  .0032  for 
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the  failure  rate  of  the  main  population  (XQ).  The  MIE  estimates  of  the 

model  parameters  should  be  compared  against  the  planning  estimates  of  DjN 

and  SS  to  determine  appropriate  corrective  action.  The  parameter 

estimation  procedure  should  be  applied  to  several  batches  of  screened 

items,  and/or  confidence  limits  should  be  calculated  for  the  MLE 

parameters  to  verify  that  significant  differences  from  planning  estimates 

exist.  Caution  should  be  exercised  in  interpreting  the  MLE  estimates  of 

the  COE  model  parameters.  In  most  instances,  the  time  duration  of  a 

screen/test  is  insufficient  to  obtain  any  precision  in  the  estimate  of  XQ, 

the  failure  rate  of  the  "nondefective"  population.  It  is  therefore 

recommended,  as  a  first  step,  that  \Q  be  set  to  zero,  or  that  a  prior 

estimate  of  X„  be  used.  Prior  estimates  of  X^  can  be  obtained  from 
o  o 

development  phase  reliability  tasks,  i.e.,  from  a  MIL-HDBK-217  prediction 
or  from  the  results  of  a  MIt-STD-781  demonstration  test. 

4.11.4.3  Comparing  Observed  and  Planning  Estimates  of  and  TS.  In 
practice  the  "true"  values  of  incoming  defect  density  and  test  strength  can 
differ  significantly  from  planning  estimates.  When  significant  difference 
exist  ,  both  the  outgoing  defect  density  nnd  costs  are  effected.  Under 
certain  conditions,  differences  from  planning  estimates  will  jeopardize 
achieving  goals  on  remaining  defect  density,  whereas  in  other  cases,  the 
differences  will  have  more  of  an  impact  on  costs.  The  corrective  action 
required  to  assure  achievement  of  screening  program  goals  will  differ, 
depending  upon  the  degree  of  departure  from  planned  values  and  whether  D^, 
TS  or  both  are  higher  or  lower  than  planning  estimates.  It  must  also  be 
recognized  that,  given  effective  corrective  actions,  good  process  control 
and  the  removal  of  defects  from  the  product,  DjN  would  be  expected  to 
decrease  rather  rapidly  during  tt^ev  initial  stages  of  screening.  It  is, 
therefore,  necessary  to  establish  monitoring  schedules  and  lot  sampling 
techniques,  which  correlate  with  major  corrective  action  charges  so  that 
reductions  in  Dj^  and  the  effectiveness  of  corrective  actions  can  be 
measured. 


5.  Detailed  Guidelines 


5.1  ESS  Planning,  Monitoring  and  Control  Procedures.  Detailed  procedures 
and  methodologies  for  performing  the  major  tasks  involved  in  planning, 
monitoring  and  controlling  the  screening  program  are  contained  in  the 
following  sections.  There  are  five  basic  .procedures. 

•  Procedure  A  entitled,  “Planning  Estimates  of  Incoming  Defect 
Density"  Is  used  to  obtain  initial  estimates  of  the  parameter  D^*  The 
procedure  contains  tabled  values  of  part,  board  and  connection  fraction 
defective  as  a  function  of  part  quality  level  and  field  environmental 
stress.  Other  factors  which  impact  incoming  defect  density,  such  as 
maturity  and  packaging  density,  should  be  factored  into  the  estimates 
based  upon  experience  and  the  recommendations  contained  In  the  guidebook. 

•  Procedure  B  entitled,  "Screen  Selection  and  Placement"  uses  the 
results  obtained  from  Procedure  A,  to  plan  a  screening  program  to  achieve 
objectives  on  remaining  defect  density.  The  procedure  contains  tabled 
values  of  screening  strength  and  defect  failure  rates  as  a  function  of  the 
screen  parameters  and  duration.  Other  factors  which  affect  screen 
selection  and  placement,  such  as  the  quantity  of  defect  type  susceptible  to 
temperature  vs  vibration  screens,  must  be  factored  into  the  procedure 
based  upon  the  manufacturer's  experience  and  the  reconmendatlons  contained 
In  the  guideline.  Procedure  B  must  be  performed  in  conjunction  with  the 
following  two  procedures  C  and  0,  to  develop  a  screening  plan. 

•  Procedure  C  entitled,  "Failure-Free  Acceptance  Tests"  is  used  to 
establish  failure-free  acceptance  periods  which  provide  a  lower  confidence 
bound  on  yield  or  equivalently,  the  remaining  defect  density.  The  failure- 
free  acceptance  test  can  be  made  a  part  cf  the  end  item  (system)  level 
screen  or  used  as  part  of  a  separate  acceptance  test  procedure.  In  either 
case,  the  costs  of  conducting  the  FFAT  must  be  factored  into  the  screen 
selection  and  placement  and  cost  estimating  procedures. 


Procedure  D  entitled.  "  Cost  Effectiveness  Analyses"  is  used  to 
estimate  and  compare  the  costs  of  various  screen  selection  and  placement 
alternatives  In  order  to  arrive  at  a  cost  effective  screening  program.  The 
manufacturer 's  cost  of  conducting  the  screening  program  is  normalized  to  a 
cost  per  defect  eliminated.  Comparison  of  the  cost  per  defect  eliminated 
by  the  screening  program  against  a  cost  threshold  value  Is  used  to 
determine  cost  effectiveness. 

•  Procedure  E  entitled,  “Monitoring,  Evaluation  and  Control"  is  used 
to  obtain  estimates  of  the  defect  density  based  upon  the  observed  screen 
fallout  data  and  to  establish  whether  the  observed  defect  density  falls 
within  or  outside  of  predetermined  control  limits.  Comparisons  of 
observed  part  fraction  defective  and  defect  density  are  made  against 
baseline  criteria  to  prioritize  and  determine  the  need  for  corrective 
actions  which  improve  manufacturing  or  screening  process  capability. 
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5.2  Procedure  A  -  Planning  Estimates  of  Incoming  Defect  Densit. 

5.2.1  Objectives.  The  primary  objective  of  this  procedure  is  to  obtain 
planning  estimates  of  Incoming  defect  density  which  will  serve  as  a  basis 
for  planning  a  stress  screening  program.  Another  objective  is  to  estimate 
the  proportion  of  the  incoming  defect  density  which  may  be  sensitive  only 
to  vibration  or  to  temperature  screens. 

5.2.2  Methodology.  The  methodology  is  similar  to  the  procedures  used  In 
MIL-HDBK-2'17  for  estimating  failure  rates.  Tables  5.2  through  5.13  are 
used  in  the  procedure  to  obtain  Incoming  defect  density  estimates  as  a 
function  of  the  number  of  parts,  boards  and  connections  contained  In  the 
product,  their  quality  level  and  the  field  stress  environment  to  which  the 
parts  will  be  exposed.  Other  factors  which  may  affect  estimates  of 
incoming  defect  density,  such  as  the  product  or  process  maturity, 
packaging  density  or  prior  experience  should  be  used,  as  may  be 
appropriate,  to  tailor  the  estimate  to  the  unique  characteristics  of  a 
given  product  and  process.  Estimates  can  be  scaled  onward  or  downward  when 
prior  knowledge  or  experience  data  on  specific  part  types  or  manufacturing 
processes  are  available.  The  proportion  of  incoming  defect  density  which 
is  responsive  to  either  vibration  or  temperature  screens  should  also  be 
estimated.  Historical  data  has  shown  that  approximately  20 %  of  the  defects 
in  a  production  lot  are  sensitive  only  to  vibration  type  screens  and  80%  to 
temperature  screens  (Reference  2.2.5).  Each  situation,  however,  must  be 
judged  individually.  The  defect  density  estimates  obtained  by  this 
procedure  should  be  viewed  as  being  representative  of  the  user's 
(manufacturer's)  average  process  capability.  It  should  be  recognized  that 
the  estimates  obtained  by  this  procedure  are  planning  estimates  only  which 
are  required  for  establishing  a  baseline  screening  program.  Comparison  of 
the  planned  estimates  of  defect  density  against  observed  values  using 
Procedure  E,  is  the  vehicle  by  which  defect  density  is  controlled  and  the 
screening  program  objectives  and  production  reliability  assurance  are 
achieved. 

The  procedure  uses  a  three-level  equipment  breakdown  structure,  i.e. 
System,  Unit  and  Assembly,  to  illustrate  the  methodology  for  planning  a 
stress  screening  program.  Other  equipment  breakdown  structures  are,  of 


course,  possible  and  can  be  adapted  to  the  structure  used  herein.  Stress 
screening,  excluding  part  level  screening.  Is  generally  confined  to  three 
levels.  However,  If  more  levels  are  used,  the  methodology  Is  equally 
applicable,  requiring  only  the  expansion  of  the  three-level-worksheets. 

5.2.2. 1  Equipment  Breakdown.  The  equipment  to  be  screened  should  be 
depicted  In  chart  form  down  to  the  assembly  level  as  Illustrated  In  Figures 

5.1  and  5.2.  Figure  5.1  shows  the  breakdown  of  a  system  to  be  screened 
Into  three  units.  Figure  5.2  shows  the  breakdown  of  one  of  the  units  Into 
Its  constituent  assemblies. 


F1gur«  5.1  Syttem  Breakdown  Chart 


Hnure  5.2  Unit  Breakdown  Chart 


5.2.3  Procedure  Steps.  Using  the  equipment  breakdown  charts  and  the 
defect  estimation  worksheets  (Figure  5.3)  the  following  steps  should  be 
performed. 

Step  1  Assembly  Defect  Estimates.  For  each  assembly  Identified  In  the 
equipment  breakdown,  as  In  Figure  5.2.,  a  defect  estimation  worksheet  as 
shown  In  Figure  5.3  should  be  completed. 

DEFECT  ESTIMATION  WORKSHEET 


Prog ram/ Project 

System  Nomenclature 

Unit 

Identifier 

Assembly  Identifier 

Prepared  By 

Date 

Part  Type 


Microelectronic  Devices 


Fraction  Estimated 
Quantity  Defective  Defects 


1 rans istors 

Diodes 

Resistors 


Capacitors 


Inductive  Devices 


Rotating  Devices 


Relays 


Swl tches 


Connectors 


Printed  Wiring  Boards 


Connections , 

Hand  Solder 

Connections. 

Crimp 

Conin-i  lions  , 

Weld 

Connections. 

Solderless  Wrap 

Coruna  1  ions , 

Wrapped  and  Soldered 

Conina  Hons . 

Clip  Termination 

Connei i Ions , 

Ref  low  Solder 

Detect  Dens’ ty/Assembly 

Defect  Density  Total  j _ 

Fiaure  5.3  Worksheet  for  Estimating  Defect  Density 
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Step  2  Part  Type.  Determine  the  part  types  used  In  the  Item.  Part  types 
shown  on  the  worksheet  are  the  standard  types  Included  in  MIL-HDBK-217. 
Miscellaneous  part  types  can  be  added  as  necessary. 

Step  3  Quality  Level /Grade.  Enter  the  appropriate  quality  level  or  grade 
for  the  part  types  as  Indicated  by  Table  5.1. 


Table  5.1  Quality  Levels  &  Grades 


Quality 

Grade 


Equivalent  Quality  Levels* 

Passive 

Microcircuits 

Sem(conductors 

Parts 

S 

JANS 

T 

B 

JANTXV 

S 

8-0 

JANT  x 

R 

B-l 

]  JAN,  3  JANTX** 

P 

B-2 

3  JAN,  ]  JANTX** 

l  )  ?  ** 

C 

JAN 

M 

C-l 

l  JAN,  ]  LOWER** 

1  I  ^  M  ** 

2  L’  2  ” 

D 

LOWER 

L 

0-1 

PLASTIC 

commercial 

as  defined  In  MIL-HDBK-217. 

Mixture  of  quality  levels  to  obtain  quality  grade 


L"*  s/Is.'Ov'Ov’f ' s. 
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Step  4  Quantity.  Enter  the  quantity  of  each  part  and  connection  type. 


Step  5  Fraction  Defective.  Determine  the  fraction  defective  in  parts  per 
million  (PPM)  for  each  part,  connection,  board  and  connector  type  using 
Tables  5.2  through  5.13.  The  field  environment  under  which  the  equipment 
is  intended  to  operate  must  be  known. 

Step  6  Estimated  Defects.  Determine  the  estimated  defects  by  multiplying 
the  Quantity  in  Step  4  by  the  Fraction  Defective  in  Step  5  and  enter  on  the 
worksheet. 

Step  7  Defect  Density.  Enter  the  Defect  Density  for  the  Assembly  by 
adding  all  the  estimated  defects  for  all  the  parts  in  the  assembly.  Enter 
the  total  Defect  Density  by  multiplying  the  assembly  Defect  Density  by  the 
nunber  of  identical  assemblies  contained  in  the  equipment. 

Step  8  Unit  Defect  Estimates.  For  each  unit  identified  in  the  System 
Breakdown  Chart,  a  Unit  Breakdown  chart  as  shown  in  Figure  5.2  should  be 
prepared.  A  Defect  Estimation  Worksheet  should  be  completed  for  each  unit, 
as  was  done  for  the  assemblies,  including  only  those  parts  and  inter¬ 
connections  that  were  not  included  in  the  assemblies.  Determine  the 
estimated  number  of  defects  for  each  unit  by  summing  the  estimated  defects 
for  all  the  assemblies  comprising  the  unit  and  the  estimated  unit  flaws. 
Note  that  the  quantity  of  identical  assemblies  or  units  in  the  system  must 
be  used  in  calculating  defect  density.  Enter  the  totals  on  the  Equipment 
Breakdown  Chart  in  the  spaces  provided. 

Step  9  System  Defect  Estimates.  A  Defect  Estima'ion  Worksheet  should  be 
completed  for  the  system  to  estimate  the  number  of  defects  not  Included  in 
the  Unit  or  Assembly  level  estimates.  Determine  the  total  estimated  number 
of  defects  in  the  System  by  summing  the  Unit  Defect  Estimates  and  the 
quantity  from  the  System  Defect  Estimates.  This  total  is  the  incoming 
defect  density  for  the  system  which  is  used  as  the  planning  estimate  Dj^. 
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Step  10  Total  Oe^ects  Production  Lot.  The  total  defects  for  the 
production  lot  should  be  calculated  by  multiplying  the  system  defect 
density  obtained  In  Step  9  by  the  number  of  systems  to  be  produced. 


5.2.4  Part  Fraction  Defective  Tables.  Twelve  tables  are  provided  which 
contain  the  part  fraction  defective  as  a  function  of  the  part  quality  level 
and  the  field  stress  environment  to  which  the  equipment  will  be  exposed. 
Part  types  Included  In  the  tables  are: 


Microelectronic  Oevices 

Transistors 

Diodes 

Resistors 

Capacitors 

Inductive  Devices 


Rotating  Devices 

Relays 

Switches 

Connections 

Connectors 

Printed  Wiring  Boards 


TABLE  5.3  PART  FRACTION  DEFECTIVE,  TRANSISTORS  (PPM* 


Quality  Level 


Environment 

JANTXV 

JANTX 

JAN 

Lower 

GB 

10.9 

21.9 

109.3 

546.6 

1093.2 

GF 

34.6 

69.2 

346.0 

1730.2 

3460.4 

GM 

98.8 

189.5 

947.7 

4738.5 

9477. C 

MP 

65.2 

130.4 

651.8 

3259.0 

6518.0 

NS8 

54.3 

108.7 

543.3 

2716.5 

5433.1 

NS 

54.3 

108.7 

543.3 

2716.5 

5433.1 

NU 

109.6 

219.1 

1095.7 

5478.3 

10956.6 

NH 

99.7 

199.4 

997.0 

4985.1 

9970.2 

NUU 

104.6 

209.3 

1046.3 

6231 .7 

10463.4 

ARW 

139.2 

278.3 

1391 .6 

6957.8 

13915.6 

AIC 

52.9 

105.7 

528.5 

2642.6 

5285.1 

AIT 

80.0 

160.0 

799.8 

3998. 8 

7997.5 

AIB 

178.6 

357.2 

1786.1 

8930.5 

17860.9 

AIA 

104.6 

209.3 

1046.3 

5231.7 

10463.4 

AIF 

203.3 

406.5 

2032.7 

10163.4 

20326.8 

AUC 

80.0 

160.0 

799.8 

3998.8 

7997.5 

AUT 

129.3 

258.6 

1292.9 

6464.6 

12929.2 

AUB 

301 .9 

603.8 

3019.0 

15095.1 

30190.1 

AUA 

178.6 

357.2 

1786.1 

8930.5 

17860.9 

AUF 

326.6 

653.1 

3265.6 

16328.0 

32656.0 

SF 

8.0 

15.9 

79.7 

398.6 

797.3 

MFF 

65.2 

130.4 

651.8 

3259.0 

6518.0 

MrA 

89.8 

179.7 

898.4 

4491 .9 

8983.9 

USL 

183.5 

367.1 

1835.4 

9177.0 

18354.1 

ML 

208.2 

416.4 

2082.0 

10410.0 

20819.9 

CL 

3408.9 

6817.7 

34088.7 

170443.3 

340386.7 

TABLE  5.4  PART  FRACTION  DEFECTIVE,  DIODES  (PPM*) 


Environment 


Quality  Level 

JANS 

JANTXV 

JANTX 

JAN 

Lower 

Plastic 

1.2 

5.9 

11.8 

59.2 

296.2 

592.3 

1.7 

8.6 

17.2 

86.0 

430.0 

860.0 

4.3 

21.6 

43.2 

216.2 

1080.8 

2161.5 

3.2 

16.1 

32.2 

160.8 

803.8 

1607.7 

1.9 

9.4 

18.9 

94.2 

471.5 

943.1 

1 .9 

9.4 

18.9 

94.3 

471.5 

943.1 

4.9 

24.4 

48.8 

243.8 

1219.2 

2438.5 

4.5 

22.5 

45.1 

225.4 

1126.9 

2253.8 

4.7 

23.5 

46.9 

234.6 

1173.1 

2346.2 

6.0 

29.9 

59.8 

299.2 

1496.2 

2992.3 

3.8 

18.8 

37.7 

188.5 

942.3 

1884.6 

23.5 

46.9 

234.6 

1173.1 

2346.2 

32.7 

65.4 

326.9 

1634.6 

3269.2 

28.1 

56.2 

280.8 

1403.8 

2807.7 

37.3 

74.6 

373.1 

1865.4 

3730.8 

28.1 

56.2 

280.8 

1403.8 

2807.7 

32.7 

65.4 

326.9 

1634.6 

3269.2 

10.2 

5-1.2 

102.3 

511.5 

2557.7 

5115.4 

8.4 

41 .9 

83.8 

419.2 

2096.2 

4192.3 

10.2 

51.2 

102.3 

511.5 

2557.7 

5115.4 

1.2 

5.9 

11.8 

59.2 

296.2 

592.3 

3.2 

16.1 

32.2 

160.8 

803.8 

1607.7 

4.1 

20.7 

41 .4 

206.9 

1034.6 

2069.2 

7.6 

38.2 

76.5 

382.3 

1911.5 

3823.1 

8.6 

42.8 

85.7 

428.5 

2142.3 

4284.6 

128.4 

641  .9 

1283.8 

6419.2 

32096.2 

64192.3 

GB 

GF 

GM 

HP 

NSB 

NS 

NU 

NH 

NUU 

ARM 

AIC 

AIT 

AIB 

AIA 

AIF 

AUC 

AUT 

AUB 

AUA 

AUF 

SF 

MFF 

MFA 

USL 

ML 

CL 


Quality  Level 


Environment 


MIL-SPEC  Lower 


h».'; 

m 


1.2 

2.0 

5.1 

5.7 

3.1 
3.4 

8.7 

8.7 

9.3 
11.6 

2.1 

2.4 

4.4 
4.1 

5.8 

4.7 
4.4 
9.3 
9.3 

12.2 

0.9 

5.8 
7.6 

15.6 

17.9 

294.7 


3.7 

6.1 

15.4 

17.2 

9.2 

10.1 

26.2 
26.2 
27.9 

34.8 

6.3 
7.1 

13.2 

12.3 

17.5 

14.1 

13.2 

27.9 

27.9 

36.5 

2.6 

17.3 

22.7 

46.9 

53.8 
884.1 


12.3 

20.3 

51.5 

57.2 

30.7 

33.6 

87.2 
87.2 
93.0 

116.1 

20.9 

23.8 
44.0 
41.1 

58.4 

46.9 
44.0 
93.0 
93.0 

121 .8 
8.8 
57.8 

75.7 

156.4 

179.5 
2947.0 


61  .4 
101 .7 

257.4 
286.2 

153.6 
168.1 
436.2 

436.2 
465.0 

580.3 

104.6 
119.0 
219.9 

205.5 
292.0 

234.4 
219.9 
465.0 
465.0 

609.1 
44.1 

289.1 

378.5 

782.1 
897.4 

14735.0 


184.2 

305.2 

m.: 

858.7 

460.9 

504.2 
1308.5 
1308.5 
1395.0 
1740.9 

313.9 

357.1 

659.8 
616.6 
876.0 

703.1 
659.8 

1395.0 

1395.0 

1827.4 

132.3 

867.4 

1135.5 
2346.3 
2692.2 

44205.0 


TABLE  5.6  PART  FRACTION  DEFECTIVE,  CAPACITORS 


Quality 

Level 

Environment 

s 

R 

P 

M 

L 

MIL-SPEC 

Lower 

G8 

1.2 

3.8 

11.5 

38.4 

115.3 

115.3 

384.4 

GF 

1.8 

6.2 

18.4 

61.5 

184.5 

184.5 

GM 

9.0 

30.0 

89.9 

299.8 

899.4 

899.4 

2998.1 

HP 

12.7 

42.3 

126.8 

422.8 

7268.4 

1268.4 

4228.1 

NSB 

5.8 

19.2 

57.7 

192.2 

576.6 

576.6 

1921 .9 

NS 

6.3 

21.1 

63.4 

211.4 

634.2 

634.2 

2114.1 

NU 

14.3 

47.7 

143.0 

476.6 

1429.9 

1429.9 

4766.2 

NH 

18.4 

61.5 

184.5 

615.0 

1845.0 

1845.0 

NUU 

20.8 

69.2 

207.6 

691 .9 

2075.6 

2075.6 

6918.7 

ARM 

27.7 

92.2 

276.7 

922.5 

2767.5 

2767.5 

9225.0 

AIC 

3.5 

11.5 

34.6 

115.3 

345.9 

345.9 

1153.1 

AIT 

3.5 

11.5 

34.6 

115.3 

345.9 

345.9 

1153.1 

AIB 

5.8 

19.2 

57.7 

192.2 

576.6 

576.6 

1921 .9 

AIA 

3.5 

11.5 

34.6 

115.3 

345.9 

345.9 

1153.1 

AIF 

6.9 

23.1 

69.2 

230.6 

691 .9 

691  .9 

2306.2 

AUC 

a.  6 

28.8 

86.5 

288.3 

864.8 

864.8 

2882.8 

AUT 

9.2 

30.7 

92.2 

307.5 

922.5 

922.5 

3075.0 

AU8 

11.5 

38.4 

115.3 

384.4 

1153.1 

1153.1 

3843.7 

AUA 

9.2 

30.7 

92.2 

307.5 

922.5 

922.5 

3075.0 

AUF 

17.3 

57.7 

173.0 

576.6 

1729.7 

1  729.7 

5765.6 

SF 

0.9 

3.1 

9.2 

30.7 

92.2 

92.2 

307.5 

MFF 

12.7 

42.3 

126.8 

422.8 

1268.4 

1268.4 

4228.1 

MFA 

17.3 

57.7 

173.0 

576.6 

1729.7 

1729.7 

5765.6 

USL 

36.9 

123.0 

369.0 

1230.0 

3690.0 

3690.0 

12300.0 

ML 

41.5 

138.4 

415.1 

1383.7 

4151.2 

4151.2 

13837.5 

CL 

703.4 

2344.7 

7034.1 

23446.9 

70340.6 

70340.6 

234468.6 

*PPM  -  Parts  Per  Million 


TABLE  5.7  PARTS  FRACTION  DEFECTIVE,  INDUCTIVE  DEVICES  (PPM*) 


Environment 


Quality  Level 

NIL-SPEC 

Lower 

537.2 

1790.7 

1222.9 

4076.4 

1996.1 

7140.1 

2142.0 

6653.8 

1135.4 

3784.6 

1222.9 

4076.4 

2433.8 

8112.7 

2725.6 

9085.3 

3017.4 

10058.0 

3892.7 

12975.8 

1047.8 

3492.8 

1266.7 

4222.3 

1266.7 

4222.3 

1266.7 

4222.3 

i >04.4 

5681 .2 

1339.6 

4465.4 

1339.6 

4465.4 

1485.5 

4951  .7 

1485.5 

4951 .7 

1850.3 

6167.5 

537  .2 

1790.7 

1996.1 

6653.8 

2579.7 

8599.0 

5059.9 

16866.2 

5643.4 

18811 .5 

89385.3 

297951.1 

TABLE  5.8  PART  FRACTION  DEFECTIVE,  ROTATING  DEVICES  (PPM*) 


Fraction  defective  (Defects/lO^) 


5935.2 

11663.1 

30168.5 

27965.5 

14967.6 

16289.4 

34574.6 

38980.6 

43386.7 

56604.8 

12544.3 

13645.8 

15848.8 

13645.8 

23559.4 
14747.3 

18051 .9 

20254.9 

18051 .9 

25762.5 

5935.2 

27965.5 

74229.1 

83041 .2 
******* 


Quality  Level 


Environment 

MIL-SPEC 

Lower 

G8 

142.5 

210.9 

GF 

231.4 

388.8 

GM 

635.1 

1784.5 

MP 

1510.8 

4384.3 

NSB 

621 .4 

1716.0 

NS 

621  .4 

1716.0 

NU 

1031  .9 

2673.9 

NH 

2263.4 

6642.0 

NUU 

2400.2 

6915.7 

ARW 

3221.2 

9652.3 

AIC 

450.3 

724.0 

AIT 

484.5 

1100.3 

AIB 

758.2 

1442.4 

AIA 

587.2 

Air 

758.2 

1784.5 

AUC 

621  .4 

1442.4 

AUT 

689.8 

1  784.5 

AU8 

1100.3 

2810.7 

AUA 

758.2 

2126.5 

AUF 

1100.3 

3152.8 

SF 

142.5 

210.9 

MFF 

1510.8 

4384.3 

MFA 

2058.1 

5684.2 

USl 

4315.8 

13073.1 

ML 

4931 .6 

14441  .4 

CL 

N/A 

N/A 

♦PPM  -  Parts  Per  Million 
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TABLE  5.10  PART  FRACTION  DEFECT 


Environment 


MIL-SPEC 


GB 

GF 

GN 

HP 

NSB 

NS 

N(j 

NH 


1  .4 
2.4 
8.8 
12.8 
5.3 
5.3 
12.2 
19.1 


NUU 

ARW 

AIC 

AIT 

AI8 

AIA 

AIF 

AUC 

AUT 


20.3 

27.1 
5.4 

5.4 

9.4 

9.4 

12.2 

6.5 

8.5 


AUB 

ADA 

AUF 

SF 

MFF 


12.2 
12.2 
15.1 
1  .4 
12.3 


MFA 


17.4 


USL 

ML 

CL 


36.9 

41.5 

688.3 


♦Parts  Per  Mill  ion 


SWITCHES  (PPM*] 


Quality  Level 


Lower 


24.4 
44.0 

158.4 

230.6 

95.5 

95.5 

220.3 

344.1 

364.7 

488.4 

96.6 
96.6 

168.8 
168.8 
220.3 

117.2 

117.2 

220.3 
220.3 
271 .9 

24.4 

230.6 

313.1 

663.7 

746.2 
12388.6 


TABLE  5.11  PART  FRACTION  DEFECTIVE,  CONNECTIONS  (PPM*) 


Connection  Type 


Hand 

Environment  Solder  Held 


Farts  Per  Mi  1 1  ion 


Wrapped 

Solderless  and 
Wrap  Soldered 


0 

.  12 

0 

12 

0 

.06 

0 

.07 

0 

16 

0 

18 

tiwKtimwm 

ggWral 

Clip  Reflow 
Tern  Solder  Auto 


Han.,  Han., 

Std.  Lower 


mm, 


^.v;av.V,VV,v: //  e.v.v .  / :  /.  /,  r. 


[*V>V 


mi 

P? 


jy 

Sv 


riro'n 


TABLE  5.12  PART  FRACTION  DEFECTIVE,  CONNECTORS  (PPM*) 


Quality  Level 


Environment 

HIL-SPEC 

Lower 

GB 

73.7 

97.3 

6F 

83.2 

248.1 

GM 

417.7 

1204.6 

MP 

427.1 

827.7 

NSB 

219.8 

408.3 

NS 

276.3 

544.9 

NU 

639.2 

1298.9 

NH 

639.2 

1251 .8 

NUU 

686.3 

1346.0 

ARW 

921 .9 

1770.1 

AIC 

120.9 

497.8 

AIT 

168.0 

497.8 

AIB 

238.7 

733.4 

AIA 

215.1 

723.4 

AIF 

332.9 

969.0 

AUC 

262.2 

733.4 

AUT 

4C3.6 

733.4 

AUB 

497.8 

969.0 

AUA 

474.3 

969.0 

AUF 

733.4 

1440.2 

SF 

73.7 

97.3 

MFF 

427.1 

827.7 

MFA 

592.1 

1157.5 

USL  1204.6  2382.7 
ML  1393.1  2759.6 
CL  23115.8  45733.8 


Environment 


Quality  Level 


MU-SPEC 


425.0 

690.3 

1792.4 

1629.2 

1057.7 

1302.6 


3078.2 

4098.7 

731.1 

1139.3 

1053.7 

1567.9 
2261  .e 
1751.6 

3282.3 

5323.3 

4302.8 

7364.2 
425.0 

1996.5 
2670.0 

5527.3 

6139.6 

102267.9 


Lower 


4250.0 

6903.2 

17924.3 

16291.5 

10576.9 
13026.0 

26700.3 

28741.2 

30782.2 

40986.9 
7311.4 

11393.2 

18536.5 

15679.2 

22618.4 

17516.1 

32823.1 

53232.5 

43027.8 

73641.9 
4250.0 

19965.2 

26700.3 

55273.5 

61396.3 

******* 


5.3  Procedure  B  -  Screen  Selection  and  Placement 


5.3.1  Objective.  The  objective  of  this  procedure  Is  to  select  and  place 
screens  at  appropriate  levels  of  assembly  so  as  to  develop  a  screening 
program  plan  for  achieving  program  objectives  In  a  cost  effective  manner. 

5.3.2  Methodology.  Procedure  steps,  outlined  below,  should  be  performed 
Iteratively  and  In  conjunction  with  the  next  two  Procedures  C  S  0. 

Iterative  application  of  the  procedure  should  be  as  follows: 


Initial  Screen  Selection  and  Placement  (Based  upon  engineering 
evaluation,  available  facilities  and  procedure  B) 

Failure-Free  Acceptance  Tests  (Procedure  C) 

Screen  Selection  and  Placement  Modification 
Cost  Effectiveness  Analysis  (Procedure  D) 

Remaining  Defect  Density  Calculations 

Goals  on  remaining  defect  density  achieved  within  given  cost 
constraints 


Table  4.9  should  be  used  as  a  guide  for  Initial  screen  selection  and 
placement.  A  diagram  of  similar  defect  flow  chart,  as  shown  In  Figure  5.4, 
should  be  used  In  calculating  the  remaining  defects  for  various  possible 
screening  sequences. 
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5.3.3  Procedure  Steps.  Instructions  for  use  of  the  flow  chart  In  Figure 
5.4  are  as  follows: 


Step  1 .  For  each  trial  screening  sequence.  Identify  the  units  and 
assemblies  that  will  be  screened  at  their  respective  levels  and  those 
that  will  not  be  screened.  (See  Figure  5.5) 


Fiaure  5.5  Identification  of  Equipment  to  be  Screened 


Step  2.  From  the  Defect  Estimation  Worksheets  of  Procedure  A,  or  from 
the  Unit  Breakdown  Charts,  total  the  estimated  number  of  defects  In 
assemblies  to  be  screened  and  enter  in  the  block  "ASS'Y  DEF"  for 
ASSEMBLY  SCREEN  1 . 

Step  3.  Similarly,  total  the  estimated  number  of  defects  In  assemblies 
that  are  not  to  be  screened  and  enter  In  the  block  "ASS'Y  DEF"  for 
UNSCREENED  ASSEMBLIES. 

Step  4.  Repeat  Steps  2  and  3  for  Unit  and  System  levels. 


Step  5.  Select  candidate  screens  using  the  guidelines.  Determine 
screening  strengths  for  selected  screens  from  Tables  5.14  through 
5.18. 

Step  6.  Determine  and  enter  the  Detection  Efficiency  (0^)  of  the  tests 
to  be  performed  during  and  after  screening.  For  guidance,  see  Section 
4.10.3.4  of  the  guidebook. 

Step  7.  Compute  test  strengths  by  multiplying  screening  strengths  by 
their  respective  detection  efficiencies  (SS  x  D£)  and  enter. 

Step  8.  Identify  the  unscreened  assemblies  that  are  Installed  In 
unscreened  units  and  enter  the  total  estimated  number  of  defects  for 
those  assemblies  In  the  UNSCREENED  ASSEMBLIES  block  DEF  REM  1  and  In 
the  block  DEF  ENT  1  of  UNSCREENED  UNITS.  Enter  the  balance  of 
estimated  defects  for  unscreened  assemblies  In  DEF  REM  2. 

Step  9.  Determine  which  unscreened  assemblies  (DEF  REM  2)  will  be 
Installed  In  units  that  will  first  enter  UNIT  SCREEN  1,  UNIT  SCREEN  2., 
or  SYSTEM  SCREEN.  Enter  the  number  of  estimated  defects  Into  the 
corresponding  DEF  ENT  1  block (s). 

Step  10.  In  the  ASSEMBLY  SCREEN  1  block,  calculate  the  screening 
fallout,  F,  by  multiplying  the  ASS'Y  DEF  by  test  strength,  TS,  and 
enter  In  block  F.  Subtract  F  from  ASS'Y  DEF  and  enter  difference  In 
DEF  REM  and  DEF  ENT  In  ASSEMBLY  SCREEN  2. 

NOTE:  If  a  second  assembly  screen  Is  not  considered,  the  test 
strength  for  ASSEMBLY  SCREEN  2  Is  zero  and  the  defects  remaining 
(DEF  REM)  will  be  the  same  as  the  defects  entering  (DEF  ENT). 
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Step  11 .  If  TS  f  0  for  ASSEMBLY  SCREEN  2,  calculate  F  by  multiplying 
DEF  ENT  by  TS.  Subtract  F  from  OEF  ENT  and  enter  In  DEF  REM. 

Step  12.  Determine  which  of  the  screened  assemblies  will  be  Installed 
In  Units  that  will  enter  UNIT  SCREEN  1  and  those  that  will  be  Installed 
In  unscreened  units.  Enter  the  number  of  estimated  defects  Into  the 
corresponding  DEF  ENT  2  block f s > . 

Step  13.  In  the  UNIT  SCREEN  1  block,  calculate  F  by  multiplying  the 
sum  of  DEF  ENT  1  and  DEF  ENT  2  by  TS  subtract  F  from  the  sum  of  DEF  ENT 
1  and  DEF  ENT  2  and  enter  In  DEF  REM  and  In  the  block  DEF  ENT  2  of  UNIT 
SCREEN  2. 

Step  14.  In  the  UNIT  SCREEN  2  block,  repeat  step  13.  Enter  the  value 
In  DEF  REM  2  In  the  block  DEF  ENT  2  of  SYSTEM  SCREEN  if  the  System  Is  to 
be  screened  or  In  the  corresponding  block  In  UNSCREENED  SYSTEM,  If  the 
system  Is  not  to  be  screened. 

Step  15.  In  the  UNSCREENED  UNITS  block,  add  the  values  In  UNIT  DEF, 
DEF  ENT  1,  and  DEF  ENT  2  and  enter  the  sum  In  DEF  REM. 

Step  16.  Determine  which  unscreened  units  will  be  screened  as  part  of 
the  system  screen.  Add  the  estimated  defects  for  those  units  to  the 
value  In  DEF  ENT  1  of  the  SYSTEM  SCREEN  block.  Enter  the  balance  of 
estimated  defects  for  unscreened  units  in  DEF  ENT  1  of  the  UNSCREENED 
SYSTEM  block. 

Step  17.  In  the  SYSTEM  SCREEN  block,  calculate  F  and  subtract  from  the 
sum  of  DEF  ENT  1  and  OEF  ENT  2.  Enter  the  difference  in  DEF  REM. 

Step  18.  In  the  UNSCREENED  SYSTEM  block,  add  the  values  In  DEF  ENT  1 
and  DEF  ENT  2  and  enter  the  sum  in  DEF  REM. 


Step  19.  Add  the  values  In  the  DEF  REM  blocks  of  UNSCREENED  SYSTEM  and 

SYSTEM  SCREEN  blocks.  The  sum  Is  D0ut>  an  estimate  of  the  number  of 

defects  remaining  after  completing  the  candlate  screening  sequence. 

The  value  of  0Qut  must  be  equal  to  or  less  than  DR  to  satisfy  the 

specified  yield  requirement. 

The  above  19  steps  complete  the  Initial  process  of  screen 
selectlon/placement  and  remaining  defect  calculation.  The  process  shall 
be  repeated  with  alternate  or  modified  screens  since  more  than  one 
screening  sequence  may  quality  as  a  candidate  for  subsequent  cost  tradeoff 
analysis. 

5,3.4  Screening  Strength  Tables.  Tables  are  provided  which  contain  the 
screening  strength  of  various  screen  types  as  a  function  of  the  screening 
parameters  and  time  duration  of  the  screen.  The  failure  rates  for  defects, 
as  a  function  of  the  stress  level  are  also  provided.  Screen  types  Included 
are: 

•  Random  Vibration 

•  Temperature  Cycling 

•  Swept-SIne  Ylbratlon 

•  Constant  Temperature 


m 
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TAfilt  5.14  SCREENING  STRENGTH  AND  fAILURE  RATES  A0,  RANDOM  VIBRATION  SCREENS 


$ 


G-RMS  Level 


Oural ton 

(minutes)  0.5  10  IS  20  2.S  3.0  3.5  4.0  4.S  SO  5.S  6.0  6.5  7.0 


20. 

40. 

60. 

80. 

0.0891 

0.1717 

0.2480 

0.3181 

0.1339 
0.2580 
0.3726 
0.47  79 

0.1703 

0.3281 

0.4739 

0.6077 

0.2020 

0.3893 

0.5623 

0.7212 

.2573 

0.2821 

0.3055 

4958 

0.5436 

0.5088 

.7161 

0.7852 

0.8504 

.9184 

1.0070 

1 .0906 

JCS 


TABLE  5.18  SCREENING  STRENGTH  &  FAILURE  RATES  Tp. 

I  Temperature  Delta  ? 


T  Ime 
In 

Hours 


10. 


20. 


30. 


40. 


TEMPERATURE  SCREENS 


5.4  Procedure  C  -  Failure-Free  Acceptance  Test  (FFAT). 


5.4.1  Objective.  The  objective  of  this  procedure  Is  to  determine  the 
length  T  of  a  failure-free  period  which  provides  a  given  statistical  con¬ 
fidence  that  the  yield  goal  (remaining  defect  density)  has  been  achieved. 

5.4.2  Methodology.  The  values  of  three  parameters  should  be  determined  in 
establishing  failure-free  acceptance  test  requirements. 

The  predicted  or  specified  failure  rate  for  the  system 
(per  MIL-HDBK-217) 

The  average  failure  rate  of  a  defect  under  the  stress 
screen  to  be  used  in  the  FFAT.  (Tables  5.14  to  5.18  in 
Procedure  B) 

The  ratio  of  the  failure  rate  of  a  defect  and  the 
predicted  failure  rate  of  the  system. 


U)  *0  - 
<">  *0  • 

(c)  V 


Tables  5.19  through  5.28  provide  90,  80,  70,  60  and  50*  lower  confidence 
bounds  on  yield  as  a  function  of  the  parameters  defined  above  and  T,  the 
length  of  the  failure-free  period. 

5.4.3  Procedure  Steps.  The  following  outlines  the  procedural  steps 
involved  in  determining  the  failure-free  period. 

Step  1 .  Determine  the  predicted  failure  rate  for  the  system  in 
accordance  with  MIL-HDBK-217.  The  prediction  should  be  based  upon  the 
more  detailed  MIL-HDBK  stress  analysis  procedures  rather  than  simple 
part  count  estimation  procedures. 

Step  2.  Establish  the  average  defect  density  entering  the  system  level 

screen,  0TM  based  upon  prior  screening  results. 
in3 
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Step  3.  Determine  the  screen  type  most  appropriate  for  use  at  the 
system  level,  based  upon  prior  knowledge  of  screen  effectiveness  and 
the  type  of  defects  expected  to  be  present. 


Step  4.  Translate  the  yield  requirement  or  goal  into  defect  density 
which  will  remain  in  the  equipment  upon  completion  of  the  failure-free 
acceptance  test.  (i.e.  0R  s  In  yield). 

Step  5.  Determine  the  required  test  strength  for  the  screen/test  to 

reduce  D^  to  D^.  i  .e. , 

3 

Op  ■  Or*.  (1-TS) 


TS  =  1 

DlN3 

Step  6.  Use  the  estimated  test  detection  efficiency  (DE)  for  the  tests 
which  will  be  applied  at  the  system  level. 

Step  7.  Determine  the  required  screening  strength  SS  for  the  screen 
which  will  be  used  during  the  failure-free  acceptance  test,  i.e.. 


id 


Step  8 .  Select  a  screen  with  the  required  SS  determined  in  the 
previous  step  (7)  from  the  Tables  5.14  through  5.18  of  Procedure  B. 
Note  that  the  screen  should  not  be  selected  based  upon  screening 
strength  alone.  The  FFAT  screen  should  be  selected  based  upon  analyses 
of  screen  fallout  data  at  lower  assembly  levels,  the  quantity  and  type 
of  defects  expected  to  be  present  in  the  final  system  product  prior  to 
the  FFAT  and  the  screen  type  believed  to  be  most  effective  for  those 
defects. 
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Step  9.  Determine  the  failure  rate  of  a  defect  (*Xp)  for  the  screen 
selected  in  Step  8,  using  the  same  Tables  5.14  through  5.18  of 
Procedure  B. 


D 

Step  10.  Determine  the  failure  rate  ratio  — and  the  statistical 

o 

confidence  required  for  verifying  the  yield  requirement. 

Step  1 1 .  Using  Tables  5.19  through  5.28,  select  the  table 
corresponding  to  the  statistical  confidence  desired. 


Step  12.  Find  the  column  in  the  table  corresponding  to  the  ratio  -r — 

o 

and  proceeding  down  that  column,  find  the  value  of  yield  which 
corresponds  to  the  requirement  or  goal. 


! 


Step  13.  Find  the  value  of  Xp  in  the  left  most  column  of  the  table 
which  corresponds  to  the  yield  value  found  by  Step  12. 

Step  14.  Divide  the  value  of  XpT  found  in  Step  13  by  Xp,  the  defect 
failure  rate  of  Step  9,  to  determine  the  length  of  the  failure-free 
period  T. 

.Step  15.  Successful  completion  of  the  failure-free  acceptance  test 
will  provide  x%  confidence  that  the  actual  yield  is  not  less  than  the 
required  value. 


5.4.4  Tables  for  %  Lower  Confidence  Bound  on  Yield.  Tables  for  50,  60, 

70,  80,  and  90%  lower  confidence  bound  on  yield  are  provided.  The  X  % 

lower  confidence  bound  is  given  in  the  table  as  a  function  of  the  failure 

"^D  - 

rate  ratio  yr  and  the  product  of  failure  rate  of  a  defect  (Xp)  and  the 

o  T 

u 

time  duration  of  the  screen  (T).  Failure  rate  ratios  — —  ranging  from  .1 

o 

to  1 ,  in  increments  of  .1  and  from  2  to  60  or  more,  in  increments  of  1  and 
10  are  used  in  the  tables. 
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TABLE  5.21  80  PERCENT  LOWER  CONFIDENCE  BOUND  ON  YIELD 


Failure  Rate  Ratio, 


TABLE  5.22  80  PERCENT  LOWER  CONFIDENCE  BOUNO  ON  YIELD  j-B-  (1-60) 


3.00  4.00  S.00  6.00  7.00  8.00  9.00  10.00  20.00  40.00|or  Nora 


3.00 

4.00 

5.00 

0.48 

ESI 

0.44 

0.54 

nri 

0.50 

0.59 

III 

0.55 

0.64 

0.62 

0.60 

0.69 

0.66 

0.65 

0.73 

0.70 

0.69 

0.76 

0.74 

0.72 

0.79 

0.77 

0.75 

0.82 

0.79 

0.78 

0.84 

0.82 

0.81 

0.86 

0.84 

0.83 

0.90 

0.88 

0.86 

0.92 

0.90 

0.89 

0.94 

0.93 

0.92 

0.96 

0.94 

0.93 

0.97 

0.96 

0.95 

0.99 

0.98 

0.97 

0.99 

0.99 

0.98 

1.00 

1.00 

0.99 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

In 

Failure  Rate  Ratio  \ 

0 


-  »  A.U  l'A  A  ‘a  1  _ 
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TABLE  5.23  70  PERCENT  LOWER  CONFIDENCE  SOUND  ON  YIELD  (.1-1.0) 

''rt 


■  ■ 

1 

Failure  Rate  Ratio  — 

IL 

Q _ 

XpT 

0.10 

0.20 

ma 

0.70 

0.80 

0.90 

0.1 

0.14 

0.00 

Bfll 

IE 

Ed 

0.00 

0.00 

0.00 

S3 

EES 

0.2 

1.00 

0.40 

0.09 

Util 

0.03 

0.02 

0.02 

0.01 

0.01 

0.01  I 

0.3 

1.00 

1.00 

0.56 

0.27 

0.16 

0.13 

0.11 

0.09 

I2J 

B‘n‘  M 

0.4 

1.00 

1.00 

0.66 

0.44 

0.34 

0.28 

0.24 

0.21 

0.20 

0.5 

1.00 

1.00 

0.73 

0.56 

0.47 

0.41 

0.37 

0.34 

0.6 

1.00 

1.00 

1.00 

0.78 

0.66 

0.58 

0.52 

0.48 

0.7 

1.00 

1.00 

1.00 

1.00 

1.00 

0.96 

0.82 

0.72 

0.66 

0.61 

0.8 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.95 

0.85 

0.77 

0.72 

0.9 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.95 

0.87 

0.81 

1.0 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.95 

0.89 

1 .1 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.95 

TABLE  5.24  70  PERCENT  LOWER  CONFIDENCE  BOUND  ON  YIELD  JL  (1-60) 


TABLE  5.25  60  PERCENT  LOWER  CONFIDENCE  BOUND  ON  YIELD  r2- ( . 1-1.0) 
_  _ • 


■ 

Xn 

Failure  Rate  Ratio 

*0 

0.10 

m 

0.30 

0.40 

— 

0.50 

0.60 

0.70 

mi 

0.90 

m 

0.1 

1.00 

0.02 

0.00 

0.00 

0.00. 

0.00 

0.00 

0.00 

0.00 

0.2 

1.00 

1.00 

0.32 

0.15 

0.10 

0.07 

0.06 

0.05 

0.04 

0.04 

0T3 

1.00 

1.00 

1.00 

0.62 

0.40 

0.30 

0.25 

0.21 

0.19 

0.17 

0.4 

1.00 

nn 

kru 

0.79 

0.60 

0.50 

0.43 

0.38 

0.35 

0.5 

Hri 

1.00 

1.00 

1.00 

1.00 

0.88 

0.73 

0.64 

0.57 

0.53 

0.6 

If 1 

nrn 

1.00 

1.00 

1.00 

1.00 

0.93 

0.82 

0.74 

0.68 

HSjn 

1  I 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.96 

0.87 

0.81 

0.8 

fffl 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.98 

0.91 

KH 

m 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.99 

TABLE  5.26  60  PERCENT  LOWER  CONFIDENCE  BOUND  ON  YIELD  r2-  (1-60) 

Ao 


Failure  Rate  Ratio  ^ 


xnT 

1.00 

2.00 

3.00 

■■ 

5.00 

m 

B9 

.8 _ 

8.00 

9.00 

20.00 

40.00 

60.00" 
or  More 

I 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.78 

0.83 

0.87 

0.91 

0.93 

0.95 

0.97 

0.99 

1.00 

1.00 

1.00 

1.00 

1.30 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.71 

0.76 

0.80 

0.83 

0.86 

0.89 

0.91 

0.92 

0.94 

0.95 

0.96 

0.98 

0.99 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

1.00 

0.66 

0.71 

0.75 

0.78 

0.81 

0.84 

0.86 

0.88 

0.90 

0.91 

0.92 

0.94 

0.96 

0.97 

0.98 

0.98 

0.99 

1.00 

1.00 

1.00 

1.00 

0.65 

0.69 

0.73 

0.77 

0.80 

0.83 

0.85 

0.87 

0.89 

0.90 

0.91 

0.93 

0.95 

0.96 

0,97 

0.98 

0.99 

0.99 

1.00 

1.00 

1.00 

0.64 

0.68 

0.73 

0.76 

0.79 

0.82 

0.84 

0.86 

0.88 

0.89 

0.91 

0.93 

0.94 

0.96 

0.97 

0,97 

0.99 

0.99 

1.00 

1.00 

1.00 

0.63 

0.68 

0.72 

0.75 

0.78 

0.81 

0.83 

0.85 

0.87 

0.89 

0.90 

0.93 

0.94 

0.95 

0.96 

0.97 

0.99 

0.99 

1.00 

1.00 

1.00 

0.63 

0.67 

0.71 

0.75 

0.78 

0.81 

0.83 

0.85 

0.87 

0.88 

0.90 

0.92 

0.94 

0.95 

0.96 

0.97 

0.98 

0.99 

1.00 

1.00 

1.00 

0.62 

0.67 

0.71 

0.74 

0.78 

0.80 

0.83 

0.85 

0.86 

0.88 

0.89 

0.92 

0.93 

0.95 

0.96 

0.97 

0.98 

0.99 

1.00 

1.00 

1.00 

0.60 

0.65 

0.69 

0.73 

0.76 

0.79 

0.81 

0.83 

0.85 

0.87 

0.88 

0.90 

0.92 

0.94 

0.95 

0.96 

0.98 

0.99 

1.00 

1.00 

1.00 

0.60 

0.64 

0.68 

0.72 

0.75 

0.78 

0.80 

0.82 

0.84 

0.86 

0.87 

0.90 

0.92 

0.93 

0.95 

0.96 

0.97 

0.98 

0.99 

1.00 

1.00 

0.59 

0.64 

0.68 

0.72 

0.75 

0.77 

0.80 

0.82 

0.84 

0.86 

0.87 

0.90 

0.92 

0.93 

0.95 

0.96 

0.97 

0.98 

0.99 

1.00 

1.00 
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TABLE  5.27  50  PERCENT  LOWER  CONFIDENCE  BOUND  ON  YIELD  JL  (.1-1.0) 


5.5  Procedure  D  -  Cost  Effectiveness  Analysis 


5.5.1  Objective.  The  objective  of  this  procedure  Is  to  perform  cost 
analyses  so  as  to  identify  the  screen  selection  and  placement  sequences 
from  among  many  possible  alternatives,  which  provide  a  cost  effective 
screening  program. 


5.5.2  Methodology.  Both  fixed  and  recurring  screening  costs  are 
identified  for  each  candidate  screening  sequence  determined  from  Procedure 
B.  Costs  are  determined  for  each  level  of  assembly,  including  a  failure- 
free  acceptance  test  at  the  system  level.  The  total  costs  of  screening  and 
the  number  of  defects  to  be  eliminated  are  used  to  determine  the  cost  per 
defect  eliminated  by  screening.  Comparison  of  the  cost  per  defect 

is  the  criterion 


eliminated  by  screening  against 
used  for  judging  cost  effectiveness. 


5.5.3  Procedure  Steps.  The  worksheet  shown  in  Figure  5.6  or  a  similar  aid 
should  be  used.  Instructions  for  completing  the  worksheet  follow. 


System/Project 


Prepared  by  Date 


ASSEMBLY  SCREENING  COST 

Fixed  Screening  Cost  . $ 

2.  Variable  Screening  Cost  . $ 

3.  Expected  Assembly  Level  Fallout . 

4.  Average  Cost  per  Repair  (If  unknown  use  $40) . I 

5.  Screening  Repair  Cost  'multiply  line  3  by  line  4) . $ 

6.  Assembly  Level  Screening  Cost  'add  lines  1,2  and  5) . $ 

UNIT  SCREENING  COST 

T.  Fixed  TcreenTng  Cost . $ 

2.  Variable  Screening  Cost . $ 

3.  Expected  Unit  Level  Fallout . 

4.  Average  Cost  per  Repair  'If  unknown  use  $375) . $ 

5.  Screening  Repair  Cost  'multiply  line  3  by  line  4) . $ 

6.  Unit  Level  Screening  Cost  'add  lines  1,2  and  5) . $ 

SYSTEM  SCREENING  COST 

T!  Fixed  Screening  Cost . $ 

2.  Variable  Screening  Cost . $ 

3.  Expected  System  Level  Fallout . 

4.  Average  Cost  per  Repair  (If  unknown  use  $750) . $ 

5.  Screening  Repair  Cost  (multiply  line  3  by  line  4) . $ 

6.  System  Level  Screening  Cost  'add  lines  1,2  and  5) . $ 


TOTAL  SCREENING  COSTS 

7.  Total  Tfxed  Cost. .  $ 

8.  Total  Variable  Cost . $ 

9.  Total  Screening  Repair  Cost . $ 

10.  Total  Expected  Fallout . 

11.  Total  Number  of  Systems  to  be  Produced . 

12.  Total  Screening  Cost  'add  lines  7,8  and  9) . $ 

13.  Total  Screening  Cost  per  System  'divide  12  by  11) . $ 


COST  PER  DEFECT  ELIMINATED  (divide  line  12  by  10) . $ 

THRESHOLD  COST . $ 


Figure  5.6  Cost  Analyses  Worksheet 


Step  1  Fixed  Screening  Costs,  (lines  1)  Determine  the  fixed  screening 
costs  for  each  level  of  assembly.  These  costs  are  one  time  expendi¬ 
tures  necessary  to  conduct  screening  at  a  particular  assembly  level 
and  include: 

•  Cost  of  screening  facilities 

§  Cost  of  test  equipment  and  fixtures 

•  Cost  of  screening  program  planning  and  the  preparation  of 
procedures 

•  Cost  of  training 

Note  that  the  cost  of  screening  facilities,  test  e  ment  and  fix¬ 
tures  should  be  apportioned  to  the  program  for  whicn  the  cost  analysis 
is  to  be  performed.  Costs  of  facilities  and  equipment  which  will  also 
be  used  on  other  programs  should  be  allocated  in  accordance  with  the 
internal  cost  accounting  procedures  of  the  manufacturer. 

Step  2  Variable  Screening  Costs.  (Lines  2)  Determine  the  variable 
screening  costs  for  the  total  number  of  items  to  be  screened  at  each 
assembly  level.  These  costs  are  recurring  costs  which  are  different 
for  each  level  of  assembly  and  which  depend  upon  the  number  of  items  to 
be  screened/rescreened  and  tested.  During  early  production  when 
defect  density  would  be  expected  to  be  higher,  a  large  driver  of 
screening  cost  would  be  repair  and  rework  costs.  During  late 
production  when  defect  density  would  be  expected  to  be  lower,  the 
primary  driver  would  be  the  cost  of  labor  to  conduct  the  screens  and 
their  associated  tests.  The  latter  situation  would  be  expected  when 
failure-free  screens  and  tests  are  employed  at  the  system  level.  The 
costs  to  conduct  failure-free  acceptance  tests  and  associated  screens 
would  thus  be  heavily  dependent  on  the  labor  costs  for  screening  and 
testing.  Recurring  costs  Include: 

•  Cost  of  labor  to  conduct  screens  and  tests 

•  Cost  of  labor  for  screening  program  management 
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•  Cost  of  labor  to  conduct  failure  analysis  (if  got  already 
accounted  for  by  MIL-Q-9858A  section  3.5) 

•  Cost  to  record  and  analyze  screening  program  data  (if  not 
already  accounted  for  by  MIL-ST0-785B  Task  104  requirements 
for  a  closed-loop  Failure  Reporting,  Analysis  and  Corrective 
Action  System  (FRACAS). 

Step  3  Expected  Fallout.  (Lines  3)  Determine  the  expected  fallout 
for  the  total  number  of  items  to  be  screened  at  each  level  of  assembly 
and  for  each  candidate  screening  sequence  using  Procedure  B  (Figure 
5.4). 

Step  4  Average  Cost  of  Repair.  (Lines  4)  Establish  the  average  in- 
house  cost  of  labor  and  materials  to  repair  a  failed  item.  These  cost 
estimates  are  dependent  on  the  type  of  equipment  being  screened,  the 
manufacturer's  repair  and  rework  facilities  and  the  level  of  assembly 
where  the  defect  is  found.  When  estimates  are  not  available,  an 
approximate  value  is  given  in  the  worksheet. 

Step  5  Screening  Repair  Costs.  (Lines  5)  Calculate  as  indicated  on 
the  worksheet.  (Multiply  the  expected  fallout  and  the  average  cost  of 
repair). 

Step  6  Screening  Costs.  (Lines  6)  Calculate  as  indicated  on  the 
worksheet.  (Add  lines  1,  2  and  5). 

Step  7  Total  Fixed  Costs.  (Line  7)  Add  the  fixed  costs  for 
screening  for  each  level  of  assembly.  (Add  all  line  1  costs). 

Step  8  Total  Variable  Costs.  (Line  8)  Add  the  variable  costs  for 
screening  for  each  level  of  assembly  (Add  all  line  2  costs). 

Step  9  Total  Screening  Repair  Costs.  (Line  9)  Add  the  screening 
repair  costs  for  each  level  of  assembly.  (Add  all  line  5  costs). 


Step  10  Total  Expected  Fallout.  (Line  10)  Add  the  expected  fallout 
for  each  level  of  assembly.  (Add  all  line  3  entries).  This  estimate 
represents  the  total  number  of  defects  precipitated  and  detected  by  a 
candidate  screening  sequence. 

Step  11  Total  Number  of  Systems  to  be  Produced.  (Line  11)  Enter  the 
total  number  of  systems  to  be  produced  and/or  exposed  to  stress 
screening. 

Step  12  Total  Screening  Costs.  (Line  12)  Calculate  as  Indicated  on 
the  worksheet.  (Add  lines  7,  8  and  9  entries). 

Step  13  Average  Screening  Cost  Per  System.  (Line  13)  This  Is  the 
screening  cost  per  system  obtained  by  dividing  Line  12  by  Line  11 
entries. 

Step  14  Average  Cost  Per  Defect  Eliminated.  Calculate  the  in-house 
average  cost  to  eliminate  a  defect  in  the  factory  by  dividing  Line  12 
by  Line  10  entries. 

Step  15  Threshold  Cost.  (Cy)  A  threshold  cost  of  $1000  is  used  In  the 
procedure.  The  threshold  cost  is  related  to  the  field  cost  of  repair 
and  should  be  viewed  as  a  not-to-exceed  cost. 

Step  16.  After  completion  of  the  worksheet  cost  analyses,  a  comparison 
of  the  cost  threshold  (Cy)  and  the  cost  per  defect  eliminated  by  the 
screening  process  (Cp)  should  be  made.  If  Cp  >  Cy  then  the  planned 
screening  process  should  be  re-evaluated  to  determine  alternative 
screening  methods  to  reduce  costs,  so  that  Cp  <  Cy. 
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5.6  Procedure  E  -  Monitoring,  Evaluation  and  Control 


5.6.1  Objective.  This  procedure  is  used  to  monitor,  evaluate  and  control 
the  screening  and  manufacturing  process  so  as  to  assure  achievement  of 
goals  on  remaining  defect  density  (yield).  Objectives  are  to: 

(a)  Obtain  estimates  of  the  defect  density,  based  upon  the  observed 
screen  fallout  data,  and  establish  whether  the  observed  defect 
density  falls  within  or  outside  of  predetermined  control  limits. 

(b)  Compare  the  observed  part  fraction  defective  with  planning 
estimates  to  prioritize  the  need  for  corrective  actions. 

(c)  Determine  and  implement  corrective  actions  to  improve 

manufacturing  and  screening  process  capability.  Four 

complementary  procedures  are  used  to  accomplish  the  objective. 


5.  &2  Procedure  El  -  Quality  Control  Charts  for  Defect  Control  - 
Methodology.  Consider  a  batch  of  screened  items  with  the  following  data 
available: 

(a)  Estimates  of  D^  and  TS  In  accordance  with  Procedure  A  &  B. 

(b)  Number  of  items  in  the  batch. 

(c)  Observed  number  of  defects  as  fallout  (F)  from  the  screen. 


1 

I 


Figure  5.7  illustrates  the  screened  items  and  the  parameters  of  interest. 
The  screened  items  can  represent  boards,  assemblies  or  units. 
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Figure  5.7  Screen  Fallout  Data  Sample 


The  observed  fallout  can  be  above,  below  or  within  established  control 
limits  depending  upon  the  degree  to  which  the  actual  or  "true"  values  of 
Dj|^  and  TS  differ  from  the  planning  estimates.  The  worst  case  situation, 
in  terms  of  the  effect  on  remaining  defect  density  goals,  is  where  D^  is 
higher  than  the  planning  estimate  and  TS  is  lower.  is  reduced  only 
through  corrective  actions  which  reduce  future  incoming  defect  density  and 
thereby  improves  process  capability.  TS  Is  increased  by  changing  the 
screen  type,  stress  levels  or  duration  of  the  screen  and  by  increasing  the 
thoroughness  of  tests  which  are  performed  in  conjunction  with  the  screen. 
Table  5.29  illustrates  the  various  possible  conditions  that  can  exist  when 
the  "true"  values  of  and  TS  are  compared  against  planning  estimates. 
The  conditions  are  ranked  according  to  severity  and  grouped  into  four 
categories  depending  upon  whether  outgoing  defect  density  or  costs  are 
effqpted.  The  corrective  actions  required  for  each  category  are  also  shown 
In  the  table.  Note  that  regardless  of  the  outcome  o^  the  comparisons, 
corrective  actions  should  always  be  taken  to  reduce  D^  when  opportunities 
to  do  so  are  presented. 


5.6.3  Procedure  Steps. 

Step  1 .  Using  the  observed  number  of  defects  and  the  quantities  of 
parts  and  interconnection  by  type  (from  Procedure  A)  for  the  batch  of 
screened  items,  calculate  an  observed  part  fraction  defective  for  each 
part  and  interconnection  type  in  the  screened  items. 

Step  2.  Calculate  also  the  observed  defect  density  using  the 
relations: 

n.|  Pi  +  U2  P 2  ^  Pj^ 


k 

B< 


Where: 


T.  n .  *  N 


D  a 
o  o 


observed  average  part  fraction  defective  per 


the  total  number  of  parts  and  Interconnections 
per  item 

number  of  parts/interconnections  of  type  i  per 
item  (i.e.,  diodes,  transitors,  hand  soldered 
connection  etc.) 

observed  part  fraction  defective  calculated 
from  step  1  for  each  part  type 

observed  defect  density  per  item. 
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Step  3.  Rank  the  observed  part  fraction  defective  for  each  part  and 
Interconnection  type  1  from  the  largest  to  the  smallest. 

Step  4.  Determine  DjN,  the  expected  incoming  defect  density  for  the 
batch  of  Items  subjected  to  the  screen  (from  Procedure  A). 

Step  5.  Compare  the  part  fraction  defective  based  upon  observed 
fallout,  calculated  frcm  step  1  against  the  planning  estimates 
obtained  from  Procedure  A,  to  determine  those  part  types  which  show  the 
largest  (statistically  significant)  difference  from  planning 
estimates.  The  comparison  should  be  based  on  a  -statistical  test  of 
significance  which  takes  into  account  the  sample  size.  Values  of 
observed  part  fraction  defective  which  exceed  1000  PPM  should  be 
specifically  cited  for  corrective  action. 

Step  6.  Determine  the  cause(s)  for  those  part  types  showing  the 
greatest  differences  and  the  corrective  actions  necessary  to  eliminate 
the  sources  of  the  defects  from  the  product  or  process.  Corrective 
actions  might  Include,  rejection  of  a  suspect  lot  of  parts,  changing 
vendors,  rescreening  of  the  parts  at  incoming  or  changes  to  the 
manufacturing  process. 

Step  7.  Prepare  three  control  charts  with  the  following  trial  values 
for  the  mean  and  standard  deviation,  D^  -  3^  D^.  TS  -  ^jo^TS 
and  DjN  (1-TS)  -  3^0  (1-TS).  Illustrations  of  the  charts  are  shown 
in  Figure  5.8  through  Figure  5.10  with  values  of  =  3  and  TS  =  .7  as 
an  example.  The  charts  are  shown  separately,  but  note  that  the  control 
limits  overlap. 
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Figure  5.8  Control  Chart  I,  Incoming  Defect  Density 
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Figure  5.9  Control  Chart  II,  Fallout 
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Figure  5.10  Control  Chart  III,  Outgoing  Defect  Density 


Step  8.  Plot  and  compare  the  observed  value  of  observed  defect  density 
for  the  first  and  all  subsequent  batches  of  screened  items  as  follows: 


(a)  Values  of  0Q  which  exceed  the  upper  control  limit  (e.g.  4.73)  on 


Chart  I,  clearly  Indicates  that  the  planning  estimates  for 
Incoming  defect  density  (Dj^)  were  too  low,  without  having  to 
consider  TS.  Note  that  the  trial. values  for  the  mean  and  standard 
deviation,  for  Chart  I,  presume  perfect  screens  and  tests  (i.e., 
TS  *  1).  When  the  condition  is  evident  from  data,  corrective 


actions  must  be  taken  to  reduce 

'  oIN.  go 

to  steps  5  and  6.  J 

1 

(b)  Values  of  the  observed  defect  density  which 

i 

fall  above  the  upper 

control  limit  of  Chart  II 

Indicate 

the 

following  possible 

conditions  from  Table  5.29: 

Condition 

°IN 

TS 

I  b 

HI 

13k 

II  d 

HI 

HI 

i 

f 

III  f 

OK 

HI 

> 

I  a 

HI 

L°1 

HI  values  would  be  much 

IV  h 

10 

higher  than  expected 

Regardless  of  which  of  the  conditions  actually  exist,  the  question  of 

upmost  concern  is:  Is  the  incoming  defect  density  (DjN)  higher  than 

planned  or  expected?  Procedures 

E2,  E3, 

or  E4  should  be  used  to 

address  the  question. 

(c)  Values  of  the  observed  defect 

density  which 

fall  below  the  lower 

control  limit  of  Chart  II 

indicate  the 

following  possible 

conditions  from  Table  5.29: 

Cond it  ion 

°IN 

TS 

- Tc - 

OK 

To 

II  e 

L0 

L0 

III  g 

L0 

OK 

I  a 

HI 

L°) 

10  values  would  be 

III  h 

L0 

HI) 

much  lower  than  expected 

,-A 


£ 
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Regardless  of  the  condition  which  actually  might  exist  the  question  of 
upmost  concern  Is:  Is  the  test  strength  lower  than  expected? 

Procedures  E2  or  E3  should  be  used  to  address  the  question. 

(d)  Values  of  the  observed  defect  density  which  fall  within  the 
control  limits  of  Chart  II  indicate  the  following  possible 
conditions  from  Table  5.29: 


Condition 

°IN 

TS 

IV 

1 

OK 

OK 

I 

a 

HI 

LO 

III 

h 

LO 

HI 

Regardless  of  the  condition  which  actually  might  exist  the  questions 
of  upmost  concern  are:  Is  the  Incoming  defect  density  higher  than 
expected  and  Is  the  test  strength  lower  than  expected?  Procedures  E2 
or  E3  should  be  used  to  address  the  question. 

Step  9.  Evaluate  which  of  the  possible  conditions  which  might  exist  In 
Step  8  by  estimating  the  parameters  of  CDE  model  as  outlined  In 
Procedure  E2  and  E3. 

Step  10.  Control  Chart  III  represents  the  outgoing  defect  density  as  a 
function  of  the  planning  estimates,  0jN  and  TS,  at  a  given  assembly 

level.  Chart  III  also  represents  the  incoming  defect  density  at  the 

( 

next  assembly  level  of  screening,  disregarding  those  defects  which  are 
newly  Introduced  Into  the  product  at  the  next  assembly  level.  Steps  1 
through  9  are  repeated  at  the  next  assembly  level  of  screening,  but 
with  planning  estimates  of  DjN  and  TS,  A  repeat  of  Step  8a  of  the 
procedure  at  the  next  assembly  level  will  provide  some  verification 
that  estimates  of  and  TS  obtained  from  previous  screening  at  the 
previous  lower  assembly  level  were  correct. 


5.6.4  Procedure  E2  -  Use  of  COE  Model  to  Estimate  0IN  and  TS  -  Methodology. 
Obtain  estimates  of  and  TS  from  the  screening  data  and  compare  them 
with  the  results  of  control  chart  methods,  (Procedure  El).  Determine  the 
appropriate  corrective  action.  The  corrective  actions  might  include; 


Increasing  or  reducing  TS  or  DjN,  depending  upon  the  outcome  of  the 
comparison  as  indicated  by  Table  5.29  and  the  results  of  Procedure  El. 


5.6.5  Procedure  Steps.  The  results  from  several  batches  of  screened  items 
will  be  needed  to  perform  the  following: 

Step  1.  Based  upon  time-to-failure  or  cycles  to  failure  data,  obtained 
from  the  screening  fallout  over  time,  estimate  the  parameters  of  the 
Chance  Oefective  Exponential  Model.  Care  should  be  exercised  in  using 
only  part  or  interconnection  (workmanship)  fallout  data  for  the 
analyses. 

Step  2.  Compare  the  estimates  obtained  from  Step  1  with  the  planning 
estimates  of  0jN  and  TS  and  the  results  of  the  Control  Chart 
calculations  of  Procedure  El.  Establish  which  of  the  conditions  of 
Table  1  exist  and  take  the  necessary  actions  to  assure  that  the 
remaining  defect  density  goals  are  achieved  or  to  make  the  screening 
program  more  cost  effective. 

Step  3.  When  repeated  estimates  of  the  model  parameters  are  made  for 
several  batches  of  screened  Items,  and  the  estimates  indicate 
significant  differences  from  Initial  planning  estimates,  a  re- 
evaluation  of  the  screening  program  should  be  made. 

Step  4.  Change  the  screening  regimen,  as  appropriate,  to  reflect  the 
new  estimates  of  the  screening  process  variables  so  as  to  assure 
achievement  of  program  objectives. 

Step  5.  Repeat  Steps  1  through  4  Interatlvely,  on  subsequent  batches 
of  screened  items,  at  each  level  of  assembly. 


5.6.6  Procedure  E3  -  Graphical  Plotting  -  Methodology.  A  graphical 
technique  for  estimating  the  parameters  and  Xq  of  the  CDE  model  can 
also  be  used.  The  technique  uses  the  failure  rate  function  of  the  CDE 
model. 

—  *xnt 
Xs(t)  *  X0  +  D  X0  e  u 

At  lower  assembly  levels,  the  MIL-HDBK-217  predicted  failure  r*tes,  XQ  for 
the  assembly  will  be  very  small  because  of  the  relatively  small  nuirtber  of 
parts.  In  the  Interest  of  obtaining  rough  estimates  of  DjN  and  Xp,  XQ  can 
be  assuned  to  be  zero. 

x$(t)a  DX0  e 
Taking  logarithms  we  have: 

In  X$(t)  £:  In  (D  X0)  -  Xpt 

By  plotting  observed  values  of  X(t)  on  semi -log  graph  paper,  estimates  of 
Din  and  X0  can  be  obtained  as  Illustrated  In  Figure  5.11. 


Figure  5.11  Failure  Rate  vs  Time 
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5.6.7  Procedure  Steps,  Screening  results  for  a  batch  of  screened  items 
and  the  time-to-failure  for  each  defect  must  be  available  to  perform  the 
following: 

Step  1 .  Group  the  fallout  data  Into  discrete  intervals  of  time  (Oj, 
tj),  ( t i ,  t2).  For  temperature  cycling  screens  a  convenient  grouping 
would  be  by  each  temperature  cycle.  Groupings  for  vibration  screens 
might  be  in  two  minute  time  Intervals. 


Step  2. 
using: 


Estimate  the  instantaneous  failure  rate  for  each  time  interval 


A 

X, 


Where : 


xj 


fallout  during  the  interval 

estimate  of  the  instantaneous  failure  rate  during 
jth  interval. 


number  of  items  which  survived  the  (j-1)  Interval. 


Step  3.  Plot  the  estimates  of  Xj  versus  time  on  a  log-linear  scale  and 
fit  a  straight  line  to  the  data  points. 

Step  4.  Determine  the  slope  of  the  fitted  line.  The  slope  of  this 
line  provides  an  estimate  of  Ip. 

Step  5.  Determine  the  y  intercept  point  for  the  fitted  line.  The  y 
intercept  provides  and  estimate  of  DXp. 

Step  6.  Divide  the  y  intercept  DXq  by  the  slope  Xq  to  obtain  an 
estimate  of  Dj^. 
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Step  7.  Step  6  provides  a  conservative  estimate  of  DjN.  The  estimate 
should  be  divided  by  the  detection  efficiency  of  the  test  which  was 
used  in  conjunction  with  the  screen  to  obtain  DjN. 

Step  8.  Calculate  the  screening  strength  of  the  screen  by  substituting 
the  estimated  Xq  and  the  total  time  duration  of  the  screen  T  into  SS(T) 

~^0T. 

*  1  -e  V  Note  that  screening  strength  and  Xq  are  Independent  of  the 
test  detection  efficiency. 

Step  9.  Multiply  the  screening  strength  by  the  test  detection 
efficiency  to  determine  the  test  strength. 

Step  10.  Compare  the  results  obtained  against  the  planned  values  to 
determine  which  condition  of  Table  5.29  exists  and  the  required 
corrective  action. 
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5.6.8  Procedure  E4  -  90%  Control  Intervals  on  Expected  Fallout.  The 
objective  of  this  procedure  Is  to  determine  If  the  expected  number  of 
defects  in  a  batch  of  screened  Items,  based  upon  planning  estimates  of  Dj^, 
is  consistent  with  the  actual  fallout. 

5.6.9  Methodology.  This  method  should  be  applied  when  the  user,  either 
through  prior  experience  or  use  of  experiments,  has  a  high  degree  of 
confidence  that  test  strength  (TS)  values  are  correct.  The  90%  control 
limits  are  based  upon  the  Binomial  distribution.  The  model  assumes  that 
the  defects  fallout  from  the  screen  with  the  same  probability  (l.e.  test 
strength)  and  are  independent  of  one  another.  Under  these  assumptions,  the 
defect  fallout  from  the  screen  has  a  Binomial  distribution: 


P  (defect  fallout  -  k) 


■0 


TSk  (l-TS)M‘k 


Where  M  =  postulated  or  expected  number  of  defects  entering  the 
screen 

TS  =  test  strength 

k  =  0,1,  2,  .....  M. 

The  upper  90%  control  Interval  limit  (denoted  by  UL)  and  the  lower  90% 
control  interval  limit  (denoted  by  LL)  are  obtained  by  solving  the 
following  equations  for  UL  and  LL. 

UL  is  the  smallest  integer  such  that: 


M 

E 

k=UL+l 


Cl 


TSk  (1-TS)M"K  <  .05 


S 

! 


LL  is  the  largest  integer  such  that: 


LL  - 1 
E 

k=o 


C) 


TSk  ( l-TS)M’k  <  .05 


120 


9 

-■  -Tfiaitf  li  rinfiWi  ft  V fir,  r *1  n A 1  n  1  -  •  - '  v '  •  a  a '  -  ^  ~  - 


- . *  ./  ,  to.  •  •  r 

'  -  v  -  -  V*  j 

v*  */  */  -  '  -  ♦  “  •/ 


The  90%  control  Interval  is  given  by  Jll,  UL*J.  Values  of  £lL,'UL^  are 
provided  In  Table  5.30  as  a  function  of  the  test  strength  (TS)  and  the 
expected  number  of  defects  (M).  The  expected  number  of  defects  entering 
the  screen  is  accepted  as  long  as  the  fallout  lies  between  LL  and  UL. 


TABLE  5.30  90  PERCENT  CONTROL  PROBABILITY  INTERVALS 


Test 

Strength 

Expected 
No.  Of 

Oef ects 

0.50 

0.55 

0.60 

0.65 

0.70 

0.75 

0.80 

0.85 

0.90 

0.95 

5 

4 

5 

5 

5 

n 

5 

5 

5 

■a 

— 

1 

1 

1 

1 

1 

2 

2 

3 

H 
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5 

5 

mm 

1? 
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mm 
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1 H 
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mm 
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7 
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7 

7 
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2 
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6 
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7 
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8 

8 

8 

8 

2 

2 

3 

3 

3 

4 
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5 

6 
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7 

7 

8 

8 

8 

9 

9 

9 
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3 

3 
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5 
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mm 
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8 

8 
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11 
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5 
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11 
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18 

19 

19 
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7 
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_ ? _ 

11 

12 

13 

14 

16 
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5.6.10  Procedure  Steps.  Screening  results  for  a  batch  of  screened  Items 
must  be  available  to  perform  the  following: 

Step  1.  Multiply  the  planning  estimate  for  defect  density  for  the 
Item  by  the  nuntoer  of  screened  Items  In  the  batch  to  obtain  the 
expected  number  of  the  defects. 

Step  2.  Determine  the  test  strength  for  the  screen/test  which  was  used 
for  the  batch  of  Items. 

Step  3.  Find  the  value  of  test  strength  In  the  upper  row  and  the 
expected  number  of  defects  (from  Step  1)  In  the  left  most  column  of 
Table  5.30.  Find  the  90%  control  limits  In  the  Table  corresponding  to 
the  two  values. 

Step  4.  If  the  actual  number  of  defects  observed  for  the  batch  of 
screened  items  falls  within  the  90%  control  limits,  then  the  planning 
estimate  of  incoming  defect  density  is  accepted  as  being  reasonably 
correct. 

Step  5.  If  the  actual  number  of  defects  observed  for  the  batch  of 
screened  items  falls  above  the  upper  control  limits,  then  corrective 
actions  to  reduce  DjN  and/or  to  increase  the  test  strength  should  be 
determined. 

Step  6.  If  the  actual  number  of  defects  observed  for  the  batch  of 
screened  items  falls  below  the  lower  control  limit,  then  corrective 
actions  to  reduce  the  screening  regimen  should  be  determined. 
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Appendix  A 

Stress  Screening  Mathematical  Models 


10.  General.  The  fundamental  objective  of  a  stress  screening  program  is 
to  reduce  the  number  of  defects  in  a  production  lot  of  equipment  to  an 
acceptable  level  by  use  of  cost  effective  screening  regimens.  As  basic 
principles,  one  would  like  to  be  able  to  use  strong  screens  and  efficient 
tests,  within  prescribed  cost  constraints,  which  have  a  high  probability 
of  precipitating  and  detecting  defects  so  as  to  achieve  stated  objectives. 
In  order  to  transform  these  principles  into  quantitative  procedures,  it  Is 
necessary  to  define  various  measures  and  their  relationships  to  the 
screening  process.  Mathematical  models  for  predicting  important  screening 
variables  and  for  relating  them  to  field  reliability  goals  are  also  needed. 
This  Appendix  discusses  the  mathematical  definitions  and  relationships 
between  quantities  such  as  defect  density,  screening  strength  and  test 
detection  efficiency. 


10.1  Defect  Density.  Under  reasonable  assumptions  that  the  number  of 
defects  in  a  product  is  independently  and  identically  distributed,  the 
number  of  defectives  in  an  equipment  can  be  described  by  the  Binomial 
Probability  distribution,  with  parameters  N  and  P. 

Where  N  =  total  number  of  parts  in  the  equipment 

P  =  average  part  fraction  defective  over  all  part  types 

A  part,  as  defined  herein,  is  any  identifiable  item  within  the  product 
which  can  be  removed  or  repaired,  (e.g.,  discrete  semiconductor,  resistor, 
integrated  circuit,  solder  joint,  connector).  For  large  N  and  small  P  the 
Binomial  can  be  approximated  by  the  Poisson  distribution  with  the 
parameter  D  =  NP 


Where  0 


Defect  Density  (average  number  of  defects  per  item) 


The  defect  density  0  *  NP  can  also  be  represented  as: 


k 

0  *  NP  -  l  n,  p,  (A-1) 

1*1  1  1 

where:  n^  *  quantity  of  each  part  type  i 

p^  *  fraction  defective  for  each  part  type  1 

k  *  number  of  different  part  types 

The  procedures  contained  in  Procedure  A  of  Section  5,  for  obtaining 
planning  estimates  of  defect  density,  are  based  upon  the  mathematical 
relations  just  described. 

10.2  Defect  Density  and  Yield.  Given  prior  estimates  of  p^,  equation  A-1 
can  be  used  to  estimate  0jN,  the  incoming  defect  density  before  assembly 
screening,  since  N  and  n^  are  known  for  the  assemblies  and  equipment  to  be 
screened.  The  outgoing  or  remaining  defect  density  0R  can  be  described  in 
a  similar  manner,  except  that  the  p^,  of  equation  1,  would  be  interpreted 
as  the  remaining  part  fraction  defective.  In  terms  of  a  production  lot  of 
equipment  DjN  and  0R  can  also  be  expressed  as: 

total  #  of  oefects  Introduced 

total  #  of  equipments  in  the  Lot 

total  #  of  defects  remaining 

total  #  of  equipments  in  the  Lot 
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Without  ar  ESS  program,  a  production  lot  of  equipments  will  contain 
defects  which  are  introduced  into  the  equipments  as  escapes  frotn  previous 
part  level  screens  and  by  poor  workmanship  or  manufacturing  processes.  The 
defects  introduced  are  expressed  quantitatively  as  the  average  number  of 
defects  per  equipment  Dj^  or  defect  density.  Using  the  Poisson  probability 
distribution,  the  probability  that  an  equipment  is  defective  P(D)  (  i.e., 
contains  one  or  more  defects)  is  given  by: 


P(D)  =  1 


(A-2) 


The  objective  of  an  ESS  program  is  to  reduce  DjN  to  an  acceptable  level, 
say  Dp,  where  Dp  is  defined  as  the  average  number  of  defects  remaining  per 


equipment  at  delivery  to  the  customer.  Reducing  D^  to  Dp  also  reduces 
P(D)  so  that: 


P(D)  =  1 


(A-3) 


The  probability  that  an  equipment  is  defect-free  when  offered  for 
acceptance  is  called  Yield  and  using  A-3. 


Yield  =  1  -  P(D)  =  e 


(A-4) 


If  the  Yield  is  specified  as  a  goal,  then  Dp  can  be  determined  by: 

Dp  =  -In  (Yield)  (A-5) 

and  used  as  an  objective  for  which  an  ESS  program  can  be  planned, 
implemented  and  subsequently  monitored  and  controlled.  Both  Dp  and  Yield 
are  used  in  the  guidebook  Procedures  B  and  E,  as  the  quantitative  goal  of 
the  ESS  program. 
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10.3  Screening  Strength.  The  screening  strength  (SS)  of  a  screen  is 
expressed  as  the  probability  that  the  screen  wiil  precipitate  a  defect  to  a 
detectable  state  given  that  a  defect  susceptible  to  the  screen  Is  present. 
Expressed  as  a  function  of  time,  the  screening  strength  Is: 


SS(t)  =  1  -  e 


(A-6) 


where:  SS(t)  =  Screening  strength  associated  with  a  given  screen 

type  for  stress  duration  of  time  t 

Xq  =  average  failure  rate  of  a  defect  under  a  given  set  of 
stress  conditions.  Note  that  under  the  exponential 
assumption  Xq  is  constant.  However,  Xp  corresponds  to  a 
specific  set  of  stress  conditions,  l.e.,  larger  stresses 
correlate  to  larger  but  constant  lD's. 

Screening  strength  and  defect  failure  rates  for  various  screen  types  are 
given  in  Tables  5.14  through  5.18. 


10.4  Screening  Strength  and  Yield.  Screens  are  used  to  precipitate  defects 
to  failure.  Using  the  relationships  described  previously,  DjN  the 
incoming  defect  density  is  acted  upon  by  the  screening  strength  SS(t)  to 
produce  fallout  from  the  screen. 


0IN  •  SS{t)  =  F  (fallout)  (A-7) 


The  remaining  defect  density  after  the  last  screen  Is  applied 
given  by: 

°R  =  °IN  0  •  SS(t)) 


is  Dr  and  Is 
(A-8) 


A4 


Substituting  equation  A-8  into  equation  A-4  gives  the  following  expression 
for  yield: 


(A-9) 


Equation  A-9  provides  one  of  the  relations  for  determining  failure-free 
acceptance  test  requirements  which  is  discussed  further  1,n  Appendix  C. 


10.5  Test  Detection  Efficiency.  The  Test  Detection  Efficiency  (DE)  is  a 
characteristic  of  a  test  which  is  measured  by  the  ratio  of  the  number  of 
possible  failure  modes  detectable  to  the  total  number  of  failure  modes. 
Detection  efficiency  is  characterized  as  the  probability  of  detection. 
Test  detection  efficiency  is  a  measure  used  in  Procedure  B.  Guidance  for 
determining  test  detection  efficiency  are  discussed  in  Section  4.10.3.4  of 
the  guidebook. 

10.6  Test  Strength.  The  Test  Strength  (TS)  is  defined  as  the  joint 
probability  that  a  screen  will  precipitate  a  defect  to  a  detectable  state 
and  that  a  test  will  detect  the  defect  and  is  given  by: 

TS  =  SS  *  DE 


10.7  Relationships  Between  DR  and  DjN.  Fig  A-l  provides  a  model  of  the 
production  screening  process  flow  which  incorporates  the  previously 
defined  quantities  (DjN,  SS,  DE,  TS  and  Dr}.  Average  rework  costs  to 
repair  or  replace  defectives  at  each  assembly  level  are  also  shown  in  the 
f 1 gure. 
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Figure  A-l  Production  Screening  Process  Flow  Model 


For  a  single  screen  i  Dout  is  related  to  DjN  by: 

°out1  s  °1N1  ^'TS1' 

and  the  fallout  F  is  given  by: 


Fi  •  DiNj  (TS)i 


l  *«  j 


k.  _  »'  »l-  »  « 
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For  multiple  screens  at  different  assembly  levels  and  assuming  that 
screening  is  applied  on  a  100X  basis  at  three  assembly  levels,  DR  is 
related  to  0JN  by: 


3 

IT 

1=1 


O-TSi)  ♦ 


3 

l  (1-TS1)  ♦  Din  (1-TS3)  (A-10) 
1  -2  3 


0 


IN 


3 

=  I 
1=1 


1  =  assembly  stages 


In  planning  an  ESS  program  and  depending  upon  screen  placement  and  the 
candidate  screening  sequences  selected,  variations  of  equation  (A-10)  are 
used  to  allocate  Test  Strengths  to  the  various  assembly  levels,  in  an 
interative  fashion,  so  as  to  achieve  the  required  0R.  Procedure  B  in 
Section  5,  "Screen  Selection  and  Placement",  is  based  upon  use  of  the 
models  and  relationships  just  described.  Screening  and  rework  costs  at 
each  level  of  assembly  must  be  taken  into  account  as  part  of  screen 
selection  and  placement  process.  Procedure  0  of  Section  5,  "Cost  Effective 
Analysis"  uses  these  costs  in  conjunction  with  the  use  of  Procedure  B. 


10.8  Cost  Effectiveness  of  ESS  Programs.  Without  an  ESS  program,  DjN 
defects  will  remain  in  the  equipment  at  delivery  and  eventually  will  fall 
early  in  field  use  due  to  the  stresses  naturally  imposed  by  the  operating 
environment.  As  the  defects  are  weeded-out  and  assuming  that  no  new 
defects  are  Introduced  during  repair,  and  that  no  design  problems  exist, 
the  reliability  of  the  equipment  can  approach  and  perhaps  exceed  predicted 
(specified)  values.  The  cost  benefits  to  the  government  of  finding  and 
eliminating  the  defects  in  the  factory  versus  the  field  depends  In  part, 
upon  the  cost  per  field  repair.  For  example.  If  the  average  cost  per  field 
repair  Is  $5000  and  the  average  cost  to  remove  the  defect  In  the  factory  Is 
$10,000  the  screening  program  Is  clearly  not  cost  effective.  In  planning 
an  ESS  program,  a  cost  threshold  Cj  Is  compared  against  the  cost  of  per 
defect  removed  In  the  factory  Cg  so  that: 


where : 

Total  Manufacturer's  Screening  Program  Costs 


Number  of  Defects  Eliminated 

And:  Cy  =  Average  cost  of  a  field  repair  ($1000  is  used) 

For  critical  missions,  where  reliability  is  of  overriding  concern  and  cost 
is  secondary,  the  cost  threshold  Cy  is  used  as  a  baseline  against  which  the 
cost  of  the  screening  program  can  be  evaluated.  The  procuring  activity 
must  decide  on  how  much  the  cost  threshold  should  be  exceeded  In  order  to 
achieve  high  reliability  requirements. 

10.9  Chance  Defective  Exponential  Model  (CPE).  The  CDE  model  is  based 
upon  the  assumption  that  the  population  of  parts  within  a  lot  of  like 
equipments  is  comprised  of  two  subpopulations,  i.e.,  a  main  subpopulation 
of  "good"  parts  and  a  much  smaller  subpopulation  of  defectives.  The 
defectives  contain  major  flaws  which  degrade  with  stress  and  time  and  are 
manifested  as  early- life  failures.  The  failure  rate  of  a  defective  part 
is  several  orders  of  magnitude  greater  than  the  failure  rate  of  a  "good" 
part.  Therefore,  relatively  few  defectives  can  dominate  the  reliability 
of  the  equipment  during  early  product  life. 

Additional  assumptions,  terms  and  definitions  which  are  used  In  the 
CDE  model  are: 

(a)  The  number  of  defectives  In  an  equipment  is  independent  and 
Identically  distributed  and  the  distribution  Is  Binomial  with 
parameters  N  and  P. 

where:  N  =  total  number  of  parts  in  an  equipment 
P  =  average  part  fraction  defective 


For  large  N  and  small  P  the  Binomial  can  be  approximated  by  the 
Poisson  distribution  so  that  0  a  NP  is  the  average  number  of 
defects  per  Item  (defect  density). 

k 

D  =  NP  =  I  n^  p^ 

1-1 


where-:  n^  *  quantity  of  part  type  1 

p.|  s  fraction  defective  part  type  1 

The  defect  density  0  Is  one  of  three  parameters  of  the  CDE  model. 

(b)  The  failure  distribution  of  the  “good"  or  main  subpopulation  of 

parts  in  an  equipment  Is  exponential  with  parameter  X  and  the 

—  X  t  ^ 

reliability  function  Is  given  by,  RQ  (t)  =  e  o  .  XQ  Is  another 
parameter  of  the  COE  model.  The  parameter  XQ  can  also  be  expressed 
as  X0-*r(N-D)  Xg,  where  Xg  is  the  average  failure  rate  of  a  "good" 
part. 

(c)  The  failure  distribution  of  a  defective  part  Is  exponential  with 

“V 

parameter  Xp  and  the  reliability  function  Is  given  by  Rq  *  e  . 
The  parameter  XQ  Is  defined  as  the  average  failure  rate  of  a 
defective  part  under  a  particular  stress  environment.  Note_that 

when  the  COE  model  is  applied  to  a  screen,  (1-Rp)  =  1  -  e  = 
SS(t),  the  screening  strength.  Note  that  the  average  failure  rate 
of  a  defective  part  Is  much  greater  than  the  average  failure  rate 
of  a  "good"  part.  I.E.  Xp  >  >  Xq  and  with  large  defect  densities 
the  failure  rate  of  the  defective  population  can  be  greater  than 
the  population  of  "goods".  I.E.  DXp  >  (N-D)  Xg. 
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Given  that  a  system  contains  n  defective  parts,  the  conditional 
reliability  of  the  system  R$  (t/n)  is: 


Rs  (t/n)  *  Rq  (t)  •  R0  (t)  n  =  0,1,2.. 


Using  the  Binomial,  the  joint  probability  of  survival  and  k  defects 
present  is: 


N 


Rs  (t/k)  *  P(k)  =  R0  (t )z  [RD  o 


N-k 


The  number  of  defective  parts 

can  be 

approximated 

by  the  Poisson  • 

with  parameter  D 

=  NP  so 

that 

the  unconditional  survival 

probability  is  given  by: 

00 

k  k 

-D 

Rs(t)  =  R0(t) 

Z  RQ(t) 

LSL 

_e _ 

(A-11) 

k=0 


ki 


Performing  the  sumnation  in  A-11  gives  the  reliability  function: 

oOv'O 


Rs(t)  *  R0(t)  e 


-v 


(A— 12) 

Using  assumptions  (b)  RQ( t )  «  e  u  and  assumption  (c)  R0(t)  s 
above;  equation  A- 12  becomes; 

D  ( 


-xDt 


Rs(t)  *  exp 


[s 1  - 0  (,-e  A°t’] 


(A- 13) 


The  failure  rate  for  the  system  X$(t)  Is  given  by: 


X_(t)  *  -  1  In  R At) 
5  dt  s 


resulting  in:  X  (t)  =  X  +  0  Xn  e 


-Xpt 


( A- 14 ) 
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The  probability  density  function  for  the  system  Is  given  by: 


fs(t)  *  X$(t)  •  Rs(t) 


so  that:  f$(t)  ■  (\>  *  0  V  X|)t]exp  ['V  -  °<>-e  V)]  (A- 15) 

The  expected  number  of  failures  for  the  system  In  time  t  Is  given  by: 


ES(T) 


m 

■J 


t  fs(t)  dt 


»  -XT 

which  gives:  E$(T)  =  XQT  +  0{l-e  ^  ) 


(A-16) 


10.10  Relating  PR  to  Field  Reliability  and  Failure  Rate.  Using  the  CDE 
model  the  reliability  and  failure  rate  of  a  system  which  has  not  had  ESS 
exposure  during  manufacture  is  given  by  equations  (A- 13)  and  ( A- 14 )  as: 

Rs(t)  =  exp|”-X0t  -  0IN  ( 1-e  ^j] 

- 

X$(t)  s  X0  +  Din  XQe 

X0  is  viewed  as  the  failure  rate  of  a  defective  under  the  field  stress 
conditions  to  which  the  system  will  be  exposed  and  X0  Is  the  MIl-HDBK-217 
predicted  or  specified  failure  rate  for  the  system. 


Given  the  same  system  which  has  been  exposed  to  ESS  during  manufacture. 


then  DjN  is  reduced  0R  and  the  other  model  paramters  XQ  and  Xq  have  the 
same  interpretation  as  before.  The  failure  rate  function  (equation  A- 14) 
both  with  and  without  an  ESS  program  is  illustrated  in  Fig  A-2. 


Figure  A-2  Field  Failure  Rate  vs  Defect  Density 

The  shaded  area  represents  the  defects  removed  from  the  product  as  a  result 
of  the  ESS  program  conducted  during  manufacture. 
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Establishing  Goals  for  Remaining  Defect  Density  (Yield) 

10.  General.  In  establishing  goals  for  remaining  defect  density,  It  is 
necessary  to  relate  measures  which  normally  fall  within  the  realm  of 
statistical  quality  control  (a  manufacturing  function)  to  measures  which 
fall  within  the  realm  of  reliability  (a  design  function).  The  primary 
distinction  between  statistical  quality  control  and  reliability  measures 
is  that  in  the  former,  the  measures  are  related  to  static  populations  and 
their  sanple  statistics,  whereas  in  the  latter  the  measures  are 
dynamically  related  to  product  performance  over  time  in  the  field  mission 
environment.  For  example,  defect  density  is  a  static  qiallty  control 
measure  and  the  failure  rate  or  MTBF  Is  a  reliability  measure,  These  two 
measures  are  used  to  arrive* at  values  for  remaining  defect  density.  Two 
methods  are  described  below,  one  makes  use  of  the  failure  rate  function  of 
the  CDE  model  and  the  other  uses  a  lower  bound  on  the  part  fraction 
defective  of  50  PPM.  Both  methods  relate  defect  density  and  failure  rates 
and  lead  to  reasonably  consistent  estimates  for  remaining  defect  density. 

10.1  Failure  Rate  Function  -  CDE  Model.  Using  the  failure  rate  function 
for  the  CDE  model  and  assuming  a  remaining  defect  density  of  DR  the  system 
failure  rate  In  the  field  environment  as  a  function  of  time  is  given  by: 

V*)  =  Xo  *  °R  vV  (B-l) 

Where : 

X$(t)  -  failure  rate  of  the  system  at  time  t 

-  specified  failure  rate  for  the  system  (non-screenable  defects) 
Dr  -  average  number  of  defects  remaining  per  system  at  delivery 
Xq  -  average  failure  rate  of  a  defect  in  the  field  environment 
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For  t=0,  at  the  start  of  equipment  life  in  the  field  environment  equation 
(B-l )  becomes: 

Xs(0)  =  X0  +  0RXD  (B-2) 

The  system  failure  rate  at  t=0  is  thus  seen  to  be  the  sum  of  XQ,  the 
contractually  specified  or  predicted  failure  rate  and  DRXD,  the  product  of 
the  field  failure  rate  of  a  defect  and  the  remaining  defect  density.  When 
the  defect  density  0R  =0,  the  failure  rate  of  the  system  at  the  start  of 
equipment  life  is  equal  to  XQ|  the  specified  failure  rate. 

The  definition  of  a  latent  defect  is  not  precise,  i.e.  a  latent  defect  is 

an  inherent  or  induced  weakness  which  results  in  premature  or  early  failure 

of  the  product  in  its  intended  use  environment.  What  is  an  early  or 

premature  failure?  To  be  slightly  more  precise  one  might  say  that  latent 

defects  represent  a  subpopulation  in  the  equipment,  whose  average  failure 

rate  differs  significantly  from  the  main  population  of  "good"  parts.  The 

average  failure  rate  of  a  "good"  part  is  in  the  range  of  approximately  1 

failure  per  10®  -  10^  operating  hours  (MIL-HDBK-217).  It  would  therefore 

be  reasonable  to  assume  that  the  average  failure  rate  of  defective  In  the 

field  must  be  greater  than  one  failure  per  thousand  hours  in  order  to  be 

considered  a  prematurely  failing  latent  defective.  Failure ' rates  for 
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defects  which  are  in  the  range  of  10  to  10  ,  are  indeed  possible,  but 

they  would  be  indistinguishable  from  the  main  population  as  early 
failures.  To  suimiarize  then,  and  in  order  to  provide  a  slightly  more 
precise,  but  sill  arbitrary  definition:  a  latent  defect  can  be  defined  as 
an  inherent  or  induced  weakness  which  has  a  failure  rate  in  the  field 
environment  which  is  greater  than  10"^  failures  per  hour. 

Stress  screening  is  designed  to  accelerate  failure  mechanisms  of 
latent  defects  so  that  the  defects  can  be  precipitated  to  failure  earlier 
than  they  would  have  failed  in  the  intended  use  environment.  Stated 
another  way,  stress  screens  are  used  to  accelerate  the  failure  rate  of 
defectives. 
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Returning  to  the  CDE  failure  rate  equation  (B-l)  and  dividing  both 
sides  of  the  equation  by  XQ  we  have: 


xs(o) 


°R  XD 


1  + 


(B-3) 


In  equation  (B-3),  Letting: 


X$(o) 


Failure  Rate  of  the  system  at  t  »  o 


Specified  failure  rate  of  the  system 


and: 


Failure  rate  of  a  defect 


Specified  failure  rate  of  the  system 


Equation  (B-3)  then  becomes: 
R1  =  1  + 

and  solving  for  0R  we  have 


(B-4) 


Given  that  a  failure  rate  for  the  system,  which  Is  10*  larger  than  the 
specified  failure  rate  at  the  start  of  product  life  is  considered 
acceptable,  then  R^  *  1.1.  In  addition,  as  was  previously  discussed,  a 

reasonable  range  for  the  failure  rate  of  a  latent  defect  in  the  field 

-3  -3 

environment  is  >  10  failures  per  hour.  Selecting  the  upper  value  of  10 

then  the  ratio  R,  can  be  calculated  as  a  function  of  the  specified  failure 

rate,  i.e.,  R£  a  10_  Solving  equation  (B-4)  for  DR,  using  R^  =  1.1  and  R2 

X° 

=  10"^ /XQ,  results  In  the  following  table  for  remaining  defect  density  as  a 

function  of  the  specified  failure  rate  X  . 

0 

B3 


Table  B-l  Remaining  Defect  Density  Dp  vs  Specified  Failure  Part 


R 


1 


1.1 


-3 


XQ(specif led) 

MTBF 

dr 

.1 

10 

10 

.01 

100 

1 

.005 

200 

.5 

.002 

500 

.2 

.001 

1000 

.1 

2000 

.05 

1  '  ’  | 

5000 

.02 

.0001 

10000 

.01 

.00001 

100000 

.0001 

A  simple  relation  for  determining  remaining  defect  density  as  a  function  of 

X  .  can  be  noted  from  the  data  in  Table  B-l  as: 
o 

100  XQ  =  Dr  (B-5) 


Table  B-2  provides  values  for  remaining  defect  density  for  values  of  Xn 

-1-4  —  u 

which  range  from  10  to  10  .  As  will  be  shown  in  the  next  section,  Xn  = 

-3  u 

10  ,  provides  values  of  DR  which  are  consistent  with  goals  on  part 

fraction  defective  of  50  PPM. 


Table  B-2  Remaining  Defect  Density  (D^)  vs  Specified  Failure  Rate 


R1  =  1.1  and  XQ  =  10"\  10"2,  10"3,  10‘4 


Specified 

Failure 

Rate 

Xo 

Defect  Faijure  Rate 

XD 

10"1 

10'2 

10"3 

10“4 

.1 

.1 

1 

10 

100 

.01 

.01 

.1 

1 

10 

.005 

.05 

.5 

5 

.002 

.002 

.02 

.2 

2 

o 

o 

• 

.001 

.01 

.1 

1 

.0005 

.005 

.05 

.5 

.0002 

.0002 

.002 

.02 

.2 

.0001 

.0001 

.001 

.01 

.1 

.00001 

.00001 

.00001 

.0001 

.01 

10.2  Remaining  Part  Fraction  Defective  Goals  in  PPM.  Determining  goals 
on  remaining  defect  density  for  an  equipment  can  also  be  approached  by 
using  goals  on  the  remaining  fraction  defective  for  the  parts  contained  in 
the  equipment.  Recall  from  the  discussions  on  the  relationships  between 
part  and  assembly  fraction  defective,  in  Section  4.6  that,  if  reasonable 
yields  are  to  be  achieved,  part  fraction  defective  levels  must  be  <  100 
PPM.  The  method  described  below  uses  a  goal,  for  the  part  fraction 
defective,  of  50  PPM  to  obtain  estimates  of  remaining  defect  density.  The 
calculations,  shown  below,  are  presented  only  to  illustrate  consistency 
with  the  results  obtained  in  the  previous  section.  The  method  should  not 
be  used,  in  practice,  to  determine  remaining  defect  density  goals.  The  CDE 
failure  rate  model  of  Section  10.1  should  be  used. 


Using  a  series  model,  the  failure  rate  of  an  equipment  can  be  expressed 
as  the  sum  of  the  failure  rate  of  the  electronic  parts  (diodes, 
transistors,  etc.)  and  the  interconnections  (wire  wrap,  hand  solder,  etc.) 
which  comprise  the  system.  Assuming  average  failure  rates  for  the  parts 
and  interconnections  in  the  equipment,  the  system  failure  rate  (X$)  is 
given  by: 


X 


s 


NP  *  Nc  xc 


(B-6) 


where : 


Number  of  electronic  parts 

Number  of  interconnections 

Average  failure  rate  of  the  parts 

Average  failure  rate  of  the  interconnections 


Reasonable  values  for  X  and  X  are,  respectively,  .5  x  10  and  .0003  x 
-6  P  c 

10  failures  per  hour  (per  MIL-HDBK-217) .  A  review  of  prediction  data  for 
various  equipment  has  shown  that  the  average  number  of  interconnections 
per  part  is  about  3.  Substituting  in  equation  (B-6)  we  have: 


X  =  . 5N  +  .000?  (3N  )  x  10-6 

s  p  p 


B6 


rt-i  iT/V 


Np  (.5  +  .0009)  x  10-6 


\e  *  .50009  N^  x  10"6 
s  p 

The  contribution  to  the  system  failure  rate  of  the  interconnections  can  be 
seen  to  be  negligible.  The  calculations  in  Table  B-3,  therefore,  use  X„  - 
.5  Np  x  10  to  estimate  the  system  failure  rate  as  a  function  of  the 
number  of  parts  used  in  the  system.  0R  is  estimated  using  the  relation  0R 
=  Np  (50PPM). 


Table  B-3  Remaining  Defect  Density  vs  Failure  Rate  -  PPM  Method 


N 

P 

Xs  =  Np(.5xl0-*) 

MTBF 

°R  =  Np  •  50PPM 

20K 

.01 

100 

1 

10K 

.005 

200 

.5 

5K 

.0025 

400 

.25 

2K 

.001 

1000 

.1 

IK 

.0005 

2000 

.05 

.2K 

.0001 

10000 

.01 

.IK 

.00005 

20000 

.005 

The  remaining  defect  density  0R  calculated  by  the  above  method  is 
consistent  with  the  COE  model  calculations  in  the  previous  Section  10.1, 
Equation  B-5,  therefore,  provides  a  reasonable  method  for  establishing 
goals  on  remaining  defect  density. 


Appendix  C 


Failure  Free  Acceptance  Test  Derivation 

10.1  General.  A  failure-free  acceptance  test  applied  at  the  system  level 
provides  a  means  of  formally  verifying  that  goals  on  remaining  defect 
density  (Yield)  have  been  achieved.  Yield  can  be  verified  by  conducting  a 
failure-free  acceptance  test  of  predetermined  length  T.  The  verified 
yield  is  defined  as  the  conditional  probability  of  having  no  defects  given 
that  the  equipment  survives  a  failure-free  period  of  length  T  without 
failure. 

10.2  Derivation.  Using  equation  A-9  of  Appendix  A,  the  yield  is  given  by: 

Yield  =  exp  |~ -0  exp  (-^T]  (C-l) 

where  D  s  defect  density  at  the  start  of  failure-free  period 

XD  =  average  failure  rate  of  a  defect  under  the  stress 
conditions  of  the  failure-free  test. 

A  lower  confidence  bound  on  yield,  based  upon  survival  of  a  failure-free 
period  of  length  T,  can  be  computed  by  calculating  an  upper  confidence 
bound  on  0.  Following  Brownlee  (Ref  2.2.10)  an  upper  confidence  bound  D 
is  obtained  by  using  the  CDE  model  reliability  function,  equation  B-13  of 
Appendix  A„  and  solving: 

exp  L-v  •  »•  .■  -  exp  (-*qT))J  =  1  -  CONF  (C-2) 


Cl 


w- 


.J>\v 


m 


f  TF77  > 

\  *  # 


* 

for  D  .  The  left  side  of  equation  (C-2)  Is  the  probability  of  surviving  T 
according  to  the  COE  model  where  XQ  is  the  predicted  or  specified  failure 
rate  for  the  equipment  and  the  other  variables  are  as  previously  defined. 
CONF  is  the  desired  confidence  level.  The  value  of  D  is  thus: 

ln^'/d  -  CONF)]  -  y/fyXo) 

0*  •  -  (C-3) 

1  -  exp  ( -XDt) 

The  upper  confidence  bound  on  D  is  then: 

D  =  Max  (0,0*) 


and  the  lower  confidence  bound  on  yield  is  given  by: 

exp  Q-D  exp  (XDt7j  •  (C-4) 

Tables  5.19-5.28,  contained  in  Procedure  D  of  Section  5,  provide  the  x  % 

— 

lower  confidence  bounds  on  yield  as  a  function  of  XpT  and  / XQ .  The 

values  in  the  tables  were  obtained  by  use  of  equations  (C-3)  and  (C-4). 


Successful  application  of  a  failure-free  acceptance  test  Is  strongly 
dependent  on  accurate  knowledge  of  the  defect  density  at  the  start  or  the 
failure-free  test  and  the  screening  strength  of  the  screen.  These  values 
should  be  obtained  from  actual  screening  process  results,  using  the 
monitoring  and  control  methods  outlined  In  Procedure  E. 
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